Jul 24 20:14:59.067440 ip-10-0-132-198 systemd[1]: Starting Kubernetes Kubelet... Jul 24 20:14:59.528637 ip-10-0-132-198 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 20:14:59.528637 ip-10-0-132-198 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 20:14:59.528637 ip-10-0-132-198 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 20:14:59.528637 ip-10-0-132-198 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 20:14:59.528637 ip-10-0-132-198 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 20:14:59.530865 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.530758 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 20:14:59.535114 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535064 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.535114 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535112 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.535114 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535117 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535120 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535123 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535127 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535130 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535132 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535137 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535140 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535143 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535145 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535148 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535151 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535154 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535156 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535159 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535162 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535164 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535168 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535171 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535175 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.535227 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535177 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535180 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535184 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535186 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535189 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535192 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535201 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535204 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535207 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535210 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535213 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535215 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535218 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535221 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535228 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535231 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535233 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535236 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.535752 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535241 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535245 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535248 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535251 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535254 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535257 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535260 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535263 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535265 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535268 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535270 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535273 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535278 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535281 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535284 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535287 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535290 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535293 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535296 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.536254 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535299 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535301 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535304 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535306 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535309 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535313 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535317 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535320 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535324 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535326 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535329 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535331 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535334 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535336 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535339 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535341 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535344 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535346 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535349 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535351 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.536733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535355 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535357 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535360 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535363 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535365 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535367 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535370 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535372 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535375 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535377 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535380 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535383 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535385 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535388 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535390 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535392 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535395 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535397 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.535400 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536170 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.537368 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536178 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536182 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536184 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536187 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536191 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536194 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536196 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536199 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536202 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536205 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536207 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536210 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536212 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536216 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536219 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536222 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536225 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536228 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536230 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536233 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.537858 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536235 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536238 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536241 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536243 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536246 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536249 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536252 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536255 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536257 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536260 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536263 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536266 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536269 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536272 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536275 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536277 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536280 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536283 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536285 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536288 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.538396 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536291 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536293 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536296 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536299 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536301 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536304 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536307 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536310 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536312 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536315 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536317 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536320 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536322 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536324 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536329 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536334 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536337 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536340 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536343 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.538896 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536346 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536349 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536352 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536354 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536357 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536360 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536363 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536366 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536370 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536373 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536375 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536378 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536381 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536384 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536386 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536389 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536391 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536394 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536397 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.539405 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536399 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536404 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536407 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536411 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536414 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536418 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536421 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536424 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536427 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536430 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536432 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536435 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536439 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536443 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536445 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536448 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536451 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536453 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536456 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.539888 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536459 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536928 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536934 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536938 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536942 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536945 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536948 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536951 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536954 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536957 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536959 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536964 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536968 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536971 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536975 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536978 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536981 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536984 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536987 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536990 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.540390 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536993 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536995 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.536998 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537001 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537003 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537006 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537009 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537011 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537013 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537016 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537019 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537022 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537025 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537027 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537032 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537035 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537038 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537041 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537044 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537046 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.540931 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537049 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537052 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537054 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537057 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537059 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537061 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537064 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537067 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537084 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537087 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537090 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537093 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537095 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537099 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537103 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537106 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537108 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537111 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537116 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.541515 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537119 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537121 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537124 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537126 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537129 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537132 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537135 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537138 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537141 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537143 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537149 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537152 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537154 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537157 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537159 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537162 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537164 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537167 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537169 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537172 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.541995 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537174 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537177 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537180 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537182 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537185 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537187 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537190 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537192 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537195 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537198 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537200 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537203 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537205 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537208 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537211 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537214 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537218 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537221 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537224 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537226 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.542546 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537228 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537312 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537329 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537338 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537345 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537351 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537357 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537364 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537369 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537373 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537376 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537380 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537383 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537386 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537391 2574 flags.go:64] FLAG: --cgroup-root="" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537394 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537398 2574 flags.go:64] FLAG: --client-ca-file="" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537400 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537403 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537409 2574 flags.go:64] FLAG: --cluster-domain="" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537412 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537415 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537418 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537422 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 20:14:59.543044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537426 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537429 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537432 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537436 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537440 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537443 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537446 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537449 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537452 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537457 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537461 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537464 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537467 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537470 2574 flags.go:64] FLAG: --enable-server="true" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537473 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537478 2574 flags.go:64] FLAG: --event-burst="100" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537481 2574 flags.go:64] FLAG: --event-qps="50" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537484 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537487 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537490 2574 flags.go:64] FLAG: --eviction-hard="" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537494 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537496 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537499 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537503 2574 flags.go:64] FLAG: --eviction-soft="" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537506 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 20:14:59.543641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537509 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537512 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537515 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537518 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537521 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537524 2574 flags.go:64] FLAG: --feature-gates="" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537528 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537531 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537534 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537537 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537540 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537543 2574 flags.go:64] FLAG: --help="false" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537547 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537550 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537553 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537556 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537560 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537564 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537567 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537570 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537573 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537576 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537579 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537582 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 20:14:59.544292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537585 2574 flags.go:64] FLAG: --kube-reserved="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537588 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537591 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537594 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537597 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537600 2574 flags.go:64] FLAG: --lock-file="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537603 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537607 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537610 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537616 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537619 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537622 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537625 2574 flags.go:64] FLAG: --logging-format="text" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537628 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537631 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537635 2574 flags.go:64] FLAG: --manifest-url="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537638 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537642 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537646 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537650 2574 flags.go:64] FLAG: --max-pods="110" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537653 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537656 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537660 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537663 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537666 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 20:14:59.544943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537669 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537673 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537681 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537684 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537687 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537690 2574 flags.go:64] FLAG: --pod-cidr="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537693 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537700 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537703 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537706 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537709 2574 flags.go:64] FLAG: --port="10250" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537712 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537715 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09fead3ef937d2e36" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537719 2574 flags.go:64] FLAG: --qos-reserved="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537722 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537725 2574 flags.go:64] FLAG: --register-node="true" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537728 2574 flags.go:64] FLAG: --register-with-taints="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537732 2574 flags.go:64] FLAG: --registry-burst="10" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537735 2574 flags.go:64] FLAG: --registry-qps="5" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537738 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537741 2574 flags.go:64] FLAG: --reserved-memory="" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537745 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537748 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537751 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537754 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 20:14:59.545628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537757 2574 flags.go:64] FLAG: --runonce="false" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537760 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537764 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537767 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537770 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537773 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537776 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537780 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537783 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537786 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537789 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537792 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537794 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537797 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537800 2574 flags.go:64] FLAG: --system-cgroups="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537803 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537809 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537812 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537815 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537819 2574 flags.go:64] FLAG: --tls-min-version="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537822 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537825 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537828 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537831 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537834 2574 flags.go:64] FLAG: --v="2" Jul 24 20:14:59.546320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537838 2574 flags.go:64] FLAG: --version="false" Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537842 2574 flags.go:64] FLAG: --vmodule="" Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537846 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.537850 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537995 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.537999 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538002 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538006 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538010 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538016 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538020 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538023 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538026 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538031 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538034 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538037 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538040 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538042 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538046 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538049 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.546952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538052 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538054 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538057 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538060 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538062 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538065 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538085 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538089 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538092 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538095 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538097 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538101 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538104 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538107 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538109 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538111 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538114 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538117 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538119 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.547503 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538122 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538124 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538129 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538153 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538157 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538161 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538166 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538169 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538172 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538175 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538178 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538181 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538183 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538186 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538189 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538191 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538194 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538197 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538199 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538202 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.547978 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538205 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538207 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538210 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538213 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538216 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538219 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538222 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538224 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538227 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538229 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538232 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538235 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538237 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538240 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538245 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538248 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538250 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538253 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538257 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.548522 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538262 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538265 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538268 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538271 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538274 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538277 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538279 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538282 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538285 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538288 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538291 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538294 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538297 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538299 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538302 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538305 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538308 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538310 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538313 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538316 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.549020 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538319 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538322 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538324 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538327 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.538329 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.539047 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.546800 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.546823 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.546845 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.546855 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546919 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546926 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546930 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546934 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546937 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.549541 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546940 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546943 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546946 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546949 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546952 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546955 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546958 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546961 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546964 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546967 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546970 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546973 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546975 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546978 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546981 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546983 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546986 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546988 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546991 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546994 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.549933 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546996 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.546999 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547001 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547004 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547009 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547012 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547015 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547018 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547021 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547024 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547026 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547029 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547032 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547035 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547037 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547040 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547042 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547045 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547048 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547051 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.550449 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547053 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547056 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547059 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547062 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547065 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547068 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547090 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547095 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547098 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547100 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547103 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547106 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547109 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547112 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547114 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547117 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547120 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547124 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547127 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.550952 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547130 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547134 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547140 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547144 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547147 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547150 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547152 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547155 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547158 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547160 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547163 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547166 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547170 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547172 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547175 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547178 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547181 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547183 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.551501 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547186 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547190 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547194 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547197 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547200 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547202 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547205 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547208 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547210 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547213 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547216 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547220 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547223 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547227 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547229 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547232 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.551951 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547235 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.547240 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547365 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547371 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547376 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547380 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547383 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547386 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547389 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547392 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547394 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547397 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547400 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547403 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547405 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 20:14:59.552378 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547408 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547411 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547414 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547416 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547419 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547421 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547424 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547427 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547429 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547432 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547435 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547437 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547440 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547443 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547446 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547449 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547452 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547455 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547458 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547460 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 20:14:59.552842 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547463 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547466 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547469 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547472 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547474 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547477 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547480 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547482 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547485 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547488 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547490 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547492 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547495 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547498 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547501 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547503 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547506 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547509 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547512 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547515 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 20:14:59.553376 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547517 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547520 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547523 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547525 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547529 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547532 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547535 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547537 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547540 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547543 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547546 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547548 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547550 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547554 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547557 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547560 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547563 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547566 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547569 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 20:14:59.553877 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547571 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547574 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547576 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547579 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547581 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547584 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547586 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547589 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547591 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547594 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547596 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547599 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547602 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547606 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547609 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547611 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547614 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547616 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547624 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 20:14:59.554487 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547627 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547629 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547632 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547635 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547638 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547640 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547643 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:14:59.547646 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.547651 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.547810 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.552429 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.553977 2574 server.go:1019] "Starting client certificate rotation" Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.554116 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 20:14:59.554957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.554177 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 20:14:59.556995 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.556970 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 20:14:59.558998 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.558975 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 20:14:59.566612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.566583 2574 log.go:25] "Validated CRI v1 runtime API" Jul 24 20:14:59.569266 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.569237 2574 log.go:25] "Validated CRI v1 image API" Jul 24 20:14:59.570147 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.570123 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 20:14:59.574758 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.574725 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85a86e1b-85cf-4fe9-b3a4-df9edd62a1a4:/dev/nvme0n1p3 adbf8b5a-797e-4228-ad0f-d718c599ac97:/dev/nvme0n1p4] Jul 24 20:14:59.574758 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.574751 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 20:14:59.581142 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.580955 2574 manager.go:216] Machine: {Timestamp:2026-07-24 20:14:59.578606218 +0000 UTC m=+0.376199334 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102608 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d4707cd45bae50c628908ea8f089 SystemUUID:ec22d470-7cd4-5bae-50c6-28908ea8f089 BootID:8f5c7be6-1c9f-419c-87b7-490a737bfb8f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:2e:e0:4a:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:2e:e0:4a:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:ed:51:2b:a1:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 20:14:59.581142 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.581115 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 20:14:59.581329 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.581287 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 20:14:59.584578 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.584542 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 20:14:59.584739 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.584580 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 20:14:59.586019 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.585999 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 20:14:59.586062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.586022 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 20:14:59.586062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.586040 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 20:14:59.586892 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.586875 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 20:14:59.588066 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.588051 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 20:14:59.588161 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.588047 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 20:14:59.589918 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.589901 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 24 20:14:59.590086 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590064 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 20:14:59.590165 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590154 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 24 20:14:59.590202 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590175 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 20:14:59.590202 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590192 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 20:14:59.590202 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590202 2574 kubelet.go:398] "Adding apiserver pod source" Jul 24 20:14:59.590323 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590214 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 20:14:59.590648 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590634 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 20:14:59.590686 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.590653 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 20:14:59.593545 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.593518 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 20:14:59.595974 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.595953 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 20:14:59.596109 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.595987 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 20:14:59.598817 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598797 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598825 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598831 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598837 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598847 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598854 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598862 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598867 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598875 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598881 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598890 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 20:14:59.598903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.598895 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 20:14:59.599849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.599836 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 20:14:59.599849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.599850 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 20:14:59.600851 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.600820 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 20:14:59.600851 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.600827 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 20:14:59.603564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.603543 2574 server.go:1268] "Started kubelet" Jul 24 20:14:59.603762 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.603650 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 20:14:59.603902 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.603789 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 20:14:59.603902 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.603817 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 20:14:59.604557 ip-10-0-132-198 systemd[1]: Started Kubernetes Kubelet. Jul 24 20:14:59.605398 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.605276 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 24 20:14:59.609748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.609711 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 20:14:59.612523 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.612434 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 20:14:59.615280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.615253 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 20:14:59.616259 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.615154 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-198.ec2.internal.18c55302fbe69c20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-198.ec2.internal,UID:ip-10-0-132-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-198.ec2.internal,},FirstTimestamp:2026-07-24 20:14:59.60350416 +0000 UTC m=+0.401097256,LastTimestamp:2026-07-24 20:14:59.60350416 +0000 UTC m=+0.401097256,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-198.ec2.internal,}" Jul 24 20:14:59.618494 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.618469 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 20:14:59.618621 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.618549 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 20:14:59.618668 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.618641 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:14:59.619492 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619466 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 20:14:59.619646 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619480 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 20:14:59.619646 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619647 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 20:14:59.619822 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619773 2574 factory.go:55] Registering systemd factory Jul 24 20:14:59.619822 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619787 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 24 20:14:59.619822 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619795 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 24 20:14:59.619822 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.619814 2574 factory.go:223] Registration of the systemd container factory successfully Jul 24 20:14:59.620192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620177 2574 factory.go:153] Registering CRI-O factory Jul 24 20:14:59.620192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620193 2574 factory.go:223] Registration of the crio container factory successfully Jul 24 20:14:59.620287 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620256 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 20:14:59.620287 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620282 2574 factory.go:103] Registering Raw factory Jul 24 20:14:59.620365 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620296 2574 manager.go:1196] Started watching for new ooms in manager Jul 24 20:14:59.620779 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.620748 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 20:14:59.620886 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.620835 2574 manager.go:349] Starting recovery of all containers Jul 24 20:14:59.620886 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.620852 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 20:14:59.628524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.628491 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlz4f" Jul 24 20:14:59.632643 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.632621 2574 manager.go:354] Recovery completed Jul 24 20:14:59.636365 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.636329 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlz4f" Jul 24 20:14:59.637531 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.637515 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.639640 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.639617 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.639750 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.639653 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.639750 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.639680 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.640361 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.640346 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 20:14:59.640361 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.640360 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.640488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.640361 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 20:14:59.640488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.640431 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 24 20:14:59.641183 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.641167 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.641248 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.641197 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.641248 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.641209 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.642627 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.642609 2574 policy_none.go:49] "None policy: Start" Jul 24 20:14:59.642705 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.642631 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 20:14:59.642705 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.642645 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 20:14:59.643876 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.643862 2574 policy_none.go:47] "Start" Jul 24 20:14:59.696220 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.695946 2574 manager.go:337] "Starting Device Plugin manager" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.696255 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696268 2574 server.go:87] "Starting device plugin registration server" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696575 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696590 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696707 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696804 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.696814 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.698207 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 20:14:59.704755 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.698262 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:14:59.706067 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.706038 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 20:14:59.707446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.707414 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 20:14:59.707574 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.707470 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 20:14:59.707574 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.707501 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 20:14:59.707574 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.707547 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 20:14:59.709760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.709729 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:14:59.797045 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.796940 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.798006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.797981 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.798143 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.798022 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.798143 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.798036 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.798143 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.798061 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.807517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.807481 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.807517 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.807520 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-198.ec2.internal\": node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:14:59.807701 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.807590 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal"] Jul 24 20:14:59.807701 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.807672 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.808649 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.808632 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.808755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.808660 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.808755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.808681 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.810028 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810013 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.810169 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.810234 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810194 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.810911 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810889 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.810987 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810917 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.810987 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.810927 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.811654 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.811634 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.811729 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.811670 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.811729 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.811681 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.812899 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.812883 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.812967 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.812919 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 20:14:59.813702 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.813687 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientMemory" Jul 24 20:14:59.813771 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.813716 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 20:14:59.813771 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.813728 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeHasSufficientPID" Jul 24 20:14:59.820952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.820927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.821101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.820957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.821101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.820975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea9ca707d62b1ca03e80e7064968f8e2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-198.ec2.internal\" (UID: \"ea9ca707d62b1ca03e80e7064968f8e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.829837 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.829808 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-198.ec2.internal\" not found" node="ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.832939 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.832912 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:14:59.835056 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.835037 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-198.ec2.internal\" not found" node="ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922161 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922161 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea9ca707d62b1ca03e80e7064968f8e2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-198.ec2.internal\" (UID: \"ea9ca707d62b1ca03e80e7064968f8e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ea9ca707d62b1ca03e80e7064968f8e2-config\") pod \"kube-apiserver-proxy-ip-10-0-132-198.ec2.internal\" (UID: \"ea9ca707d62b1ca03e80e7064968f8e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.922392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:14:59.922271 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f200dc5ffa26be918fd14a3d29070f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal\" (UID: \"31f200dc5ffa26be918fd14a3d29070f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:14:59.934033 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:14:59.934001 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.034699 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.034664 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.133721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.133628 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:15:00.135782 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.135755 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.139979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.139959 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:15:00.236649 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.236600 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.337256 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.337204 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.437945 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.437831 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.538648 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.538607 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-198.ec2.internal\" not found" Jul 24 20:15:00.541231 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.541207 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:00.550101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.550055 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:00.553851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.553831 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 20:15:00.553996 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.553976 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 20:15:00.554062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.554005 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 20:15:00.554062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.554004 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 20:15:00.591208 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.591163 2574 apiserver.go:52] "Watching apiserver" Jul 24 20:15:00.611145 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.611107 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 20:15:00.612497 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.612471 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-sczr8","openshift-dns/node-resolver-nmltz","openshift-image-registry/node-ca-9x9zw","openshift-multus/multus-5ngqv","openshift-multus/multus-additional-cni-plugins-6fhzs","openshift-multus/network-metrics-daemon-2x7rw","openshift-ovn-kubernetes/ovnkube-node-92phv","kube-system/global-pull-secret-syncer-k2lvf","kube-system/konnectivity-agent-xt42r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw","openshift-network-diagnostics/network-check-target-28d2d","openshift-network-operator/iptables-alerter-w4xdf"] Jul 24 20:15:00.614233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.614203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.615198 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.615176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.616450 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.616425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.617539 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.617510 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.617680 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.617630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zw9f6\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618274 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618406 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618530 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618719 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kxddx\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618798 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618801 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618919 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.618956 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.619573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 20:15:00.619797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.619655 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cc9lj\"" Jul 24 20:15:00.620352 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.619831 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 20:15:00.621124 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.620970 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.621124 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.621043 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.621302 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.621282 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 20:15:00.621986 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.621968 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.622124 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.622006 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 20:15:00.622124 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.622048 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:00.622124 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.622102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2x9wh\"" Jul 24 20:15:00.623384 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.623368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.625086 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.625051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.625459 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.625443 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 20:15:00.625903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.625888 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 20:15:00.626086 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626063 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 20:15:00.626154 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626113 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.626154 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626135 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mv49b\"" Jul 24 20:15:00.626458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-hostroot\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626540 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-multus-certs\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626540 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-conf\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.626628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-tmp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.626628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94029bd9-7225-4de9-b477-a42bd882ca7b-host\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.626628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-etc-kubernetes\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cnibin\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.626767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.626767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.626767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-run\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626793 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94029bd9-7225-4de9-b477-a42bd882ca7b-serviceca\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cnibin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-multus\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-kubelet\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.626947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnqz\" (UniqueName: \"kubernetes.io/projected/95e4e4ba-043f-429b-be04-a8c39f41b4a4-kube-api-access-hlnqz\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrb94\" (UniqueName: \"kubernetes.io/projected/409918d3-b2da-4844-a3f8-c341604c02f6-kube-api-access-lrb94\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.626984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5cqp\" (UniqueName: \"kubernetes.io/projected/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-kube-api-access-g5cqp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-socket-dir-parent\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-bin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-conf-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-tuned\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqs6\" (UniqueName: \"kubernetes.io/projected/94029bd9-7225-4de9-b477-a42bd882ca7b-kube-api-access-8dqs6\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-daemon-config\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-modprobe-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-os-release\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-lib-modules\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-host\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-kubernetes\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-system-cni-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-var-lib-kubelet\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-k8s-cni-cncf-io\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5s2h\" (UniqueName: \"kubernetes.io/projected/0ed90b0c-7af8-439d-850b-56e570ae6ca9-kube-api-access-q5s2h\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-os-release\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cni-binary-copy\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-netns\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysconfig\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-systemd\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-sys\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.627860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-system-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.628439 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.627902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.628439 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.628352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.628735 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.628713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 20:15:00.628833 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.628779 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qr2hb\"" Jul 24 20:15:00.629186 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.629161 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 20:15:00.629297 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.629255 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5kvjf\"" Jul 24 20:15:00.629723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.629699 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 20:15:00.629968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.629944 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.630147 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.630113 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.630266 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.630197 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:00.630459 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.630442 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.631405 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.631383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:00.631506 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.631469 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:00.631506 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.631478 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hvdnn\"" Jul 24 20:15:00.631823 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.631783 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.631932 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.631786 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.633209 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.633190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.634588 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.634565 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 20:15:00.635295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.635273 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:00.635389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.635300 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 20:15:00.635448 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.635422 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" Jul 24 20:15:00.635495 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.635475 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal"] Jul 24 20:15:00.636452 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.636433 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:00.636535 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.636433 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 20:15:00.636535 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.636530 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-462vt\"" Jul 24 20:15:00.641870 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.641813 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 20:09:59 +0000 UTC" deadline="2027-12-28 06:19:30.834109889 +0000 UTC" Jul 24 20:15:00.641870 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.641868 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12514h4m30.192245914s" Jul 24 20:15:00.646243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.646216 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 20:15:00.646388 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.646292 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal"] Jul 24 20:15:00.654559 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.654528 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-msz58" Jul 24 20:15:00.662862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.662837 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-msz58" Jul 24 20:15:00.715902 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.715855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f200dc5ffa26be918fd14a3d29070f.slice/crio-04765b94e2fd232e36d54dd4726d9927901f8a6b5a01459d8717d895e829898d WatchSource:0}: Error finding container 04765b94e2fd232e36d54dd4726d9927901f8a6b5a01459d8717d895e829898d: Status 404 returned error can't find the container with id 04765b94e2fd232e36d54dd4726d9927901f8a6b5a01459d8717d895e829898d Jul 24 20:15:00.716340 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.716318 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9ca707d62b1ca03e80e7064968f8e2.slice/crio-f7a3bf64ec1b6bc81ed3205305af78bf7dfbdc10398a0c8b29e9d4429e0451d6 WatchSource:0}: Error finding container f7a3bf64ec1b6bc81ed3205305af78bf7dfbdc10398a0c8b29e9d4429e0451d6: Status 404 returned error can't find the container with id f7a3bf64ec1b6bc81ed3205305af78bf7dfbdc10398a0c8b29e9d4429e0451d6 Jul 24 20:15:00.720548 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.720528 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 20:15:00.720789 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.720769 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 20:15:00.728120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-systemd\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-system-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-hostroot\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728167 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-systemd\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-multus-certs\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6smh\" (UniqueName: \"kubernetes.io/projected/a93e32ff-ea66-4e5a-8095-e78e658f46a0-kube-api-access-k6smh\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-system-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728242 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-hostroot\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-host-slash\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-multus-certs\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94029bd9-7225-4de9-b477-a42bd882ca7b-host\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728320 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94029bd9-7225-4de9-b477-a42bd882ca7b-host\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-etc-kubernetes\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-etc-kubernetes\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cnibin\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728447 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cnibin\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-netd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovn-node-metrics-cert\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-run\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94029bd9-7225-4de9-b477-a42bd882ca7b-serviceca\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cnibin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-multus\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.728662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728632 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728706 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-multus\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728717 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cnibin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnqz\" (UniqueName: \"kubernetes.io/projected/95e4e4ba-043f-429b-be04-a8c39f41b4a4-kube-api-access-hlnqz\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728763 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-run\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrb94\" (UniqueName: \"kubernetes.io/projected/409918d3-b2da-4844-a3f8-c341604c02f6-kube-api-access-lrb94\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-dbus\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-bin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-kubelet-config\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-slash\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-node-log\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-log-socket\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.728997 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-cni-bin\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-tuned\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.729521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729050 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94029bd9-7225-4de9-b477-a42bd882ca7b-serviceca\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/631fedfb-b4fb-415d-8654-74769ffe064a-agent-certs\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729148 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-cni-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-tmp-dir\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-ovn\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-systemd-units\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-iptables-alerter-script\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-host\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729313 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-kubernetes\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-systemd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729352 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729387 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-host\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-var-lib-kubelet\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.730419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-os-release\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysconfig\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-var-lib-kubelet\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-sys\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729525 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/631fedfb-b4fb-415d-8654-74769ffe064a-konnectivity-ca\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-socket-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-kubelet\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-conf\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.729716 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-tmp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.729796 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:01.229773235 +0000 UTC m=+2.027366345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.731196 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-bin\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7mx\" (UniqueName: \"kubernetes.io/projected/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kube-api-access-gd7mx\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-kubelet\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-device-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729970 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729416 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-kubernetes\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.729994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-var-lib-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-env-overrides\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730058 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysconfig\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-sys\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730157 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-os-release\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730176 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-sysctl-conf\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5cqp\" (UniqueName: \"kubernetes.io/projected/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-kube-api-access-g5cqp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730208 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-var-lib-kubelet\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-socket-dir-parent\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-conf-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.731940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-socket-dir-parent\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-config\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqs6\" (UniqueName: \"kubernetes.io/projected/94029bd9-7225-4de9-b477-a42bd882ca7b-kube-api-access-8dqs6\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730346 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-conf-dir\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-daemon-config\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-sys-fs\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95e4e4ba-043f-429b-be04-a8c39f41b4a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4xd\" (UniqueName: \"kubernetes.io/projected/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-kube-api-access-2b4xd\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-etc-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-modprobe-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-os-release\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-registration-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-netns\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxl5\" (UniqueName: \"kubernetes.io/projected/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-kube-api-access-vwxl5\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-os-release\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-lib-modules\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.732768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730786 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-modprobe-d\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-system-cni-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-k8s-cni-cncf-io\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5s2h\" (UniqueName: \"kubernetes.io/projected/0ed90b0c-7af8-439d-850b-56e570ae6ca9-kube-api-access-q5s2h\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-hosts-file\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730896 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-k8s-cni-cncf-io\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730904 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95e4e4ba-043f-429b-be04-a8c39f41b4a4-system-cni-dir\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-script-lib\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cni-binary-copy\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-netns\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730989 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-multus-daemon-config\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.730906 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-lib-modules\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.731054 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ed90b0c-7af8-439d-850b-56e570ae6ca9-host-run-netns\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.731324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ed90b0c-7af8-439d-850b-56e570ae6ca9-cni-binary-copy\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.733314 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-tmp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.733517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.733477 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-etc-tuned\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.737487 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.737457 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrb94\" (UniqueName: \"kubernetes.io/projected/409918d3-b2da-4844-a3f8-c341604c02f6-kube-api-access-lrb94\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:00.737487 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.737478 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnqz\" (UniqueName: \"kubernetes.io/projected/95e4e4ba-043f-429b-be04-a8c39f41b4a4-kube-api-access-hlnqz\") pod \"multus-additional-cni-plugins-6fhzs\" (UID: \"95e4e4ba-043f-429b-be04-a8c39f41b4a4\") " pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:00.741819 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.741784 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5cqp\" (UniqueName: \"kubernetes.io/projected/c7b9899c-16b3-4f79-baa3-14f95b1bf2e5-kube-api-access-g5cqp\") pod \"tuned-sczr8\" (UID: \"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5\") " pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.741977 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.741960 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqs6\" (UniqueName: \"kubernetes.io/projected/94029bd9-7225-4de9-b477-a42bd882ca7b-kube-api-access-8dqs6\") pod \"node-ca-9x9zw\" (UID: \"94029bd9-7225-4de9-b477-a42bd882ca7b\") " pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.742586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.742566 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5s2h\" (UniqueName: \"kubernetes.io/projected/0ed90b0c-7af8-439d-850b-56e570ae6ca9-kube-api-access-q5s2h\") pod \"multus-5ngqv\" (UID: \"0ed90b0c-7af8-439d-850b-56e570ae6ca9\") " pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.832307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-device-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-var-lib-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-env-overrides\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-config\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832393 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-var-lib-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832398 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-device-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-sys-fs\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4xd\" (UniqueName: \"kubernetes.io/projected/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-kube-api-access-2b4xd\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-etc-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-registration-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-sys-fs\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-netns\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832511 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxl5\" (UniqueName: \"kubernetes.io/projected/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-kube-api-access-vwxl5\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.832565 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832551 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-etc-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832575 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-registration-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-hosts-file\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832599 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-netns\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-script-lib\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832661 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-hosts-file\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6smh\" (UniqueName: \"kubernetes.io/projected/a93e32ff-ea66-4e5a-8095-e78e658f46a0-kube-api-access-k6smh\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-host-slash\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-netd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovn-node-metrics-cert\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-dbus\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-kubelet-config\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832825 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-netd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832893 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-dbus\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.832927 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43a29076-4718-4bf1-af6c-dc8ce087247f-kubelet-config\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-host-slash\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.833223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832922 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-env-overrides\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.832977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-slash\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.832995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:01.332975806 +0000 UTC m=+2.130568905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833009 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-config\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-slash\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-node-log\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-log-socket\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833062 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-node-log\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/631fedfb-b4fb-415d-8654-74769ffe064a-agent-certs\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833116 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-log-socket\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-tmp-dir\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833149 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-ovn\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovnkube-script-lib\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-systemd-units\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.833947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833231 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-ovn\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-iptables-alerter-script\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-systemd-units\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-systemd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/631fedfb-b4fb-415d-8654-74769ffe064a-konnectivity-ca\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-socket-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-kubelet\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-tmp-dir\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833275 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-bin\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833512 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-openvswitch\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7mx\" (UniqueName: \"kubernetes.io/projected/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kube-api-access-gd7mx\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-run-ovn-kubernetes\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-socket-dir\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.834779 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833591 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-run-systemd\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.835544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833603 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-cni-bin\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.835544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833806 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-iptables-alerter-script\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.835544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833827 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/631fedfb-b4fb-415d-8654-74769ffe064a-konnectivity-ca\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.835544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.833883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a93e32ff-ea66-4e5a-8095-e78e658f46a0-host-kubelet\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.835544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.835090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a93e32ff-ea66-4e5a-8095-e78e658f46a0-ovn-node-metrics-cert\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.835722 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.835705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/631fedfb-b4fb-415d-8654-74769ffe064a-agent-certs\") pod \"konnectivity-agent-xt42r\" (UID: \"631fedfb-b4fb-415d-8654-74769ffe064a\") " pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:00.841104 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.841064 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:00.841104 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.841108 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:00.841327 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.841123 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:00.841327 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:00.841194 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:01.341173509 +0000 UTC m=+2.138766605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:00.843420 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.843381 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4xd\" (UniqueName: \"kubernetes.io/projected/22f6d2ca-c02d-4a07-8f79-72508fb85ca5-kube-api-access-2b4xd\") pod \"node-resolver-nmltz\" (UID: \"22f6d2ca-c02d-4a07-8f79-72508fb85ca5\") " pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.843607 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.843591 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxl5\" (UniqueName: \"kubernetes.io/projected/53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9-kube-api-access-vwxl5\") pod \"iptables-alerter-w4xdf\" (UID: \"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9\") " pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:00.843715 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.843696 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7mx\" (UniqueName: \"kubernetes.io/projected/c5afadae-f3e4-44ff-9a02-faf337f7bf1e-kube-api-access-gd7mx\") pod \"aws-ebs-csi-driver-node-b4jxw\" (UID: \"c5afadae-f3e4-44ff-9a02-faf337f7bf1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:00.843760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.843699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6smh\" (UniqueName: \"kubernetes.io/projected/a93e32ff-ea66-4e5a-8095-e78e658f46a0-kube-api-access-k6smh\") pod \"ovnkube-node-92phv\" (UID: \"a93e32ff-ea66-4e5a-8095-e78e658f46a0\") " pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:00.944051 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.943965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sczr8" Jul 24 20:15:00.949572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.949548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmltz" Jul 24 20:15:00.953302 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.953271 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b9899c_16b3_4f79_baa3_14f95b1bf2e5.slice/crio-aaf2630bc5587228bf20564959508cf10cd1b1683569c1f3b68f2343a633081c WatchSource:0}: Error finding container aaf2630bc5587228bf20564959508cf10cd1b1683569c1f3b68f2343a633081c: Status 404 returned error can't find the container with id aaf2630bc5587228bf20564959508cf10cd1b1683569c1f3b68f2343a633081c Jul 24 20:15:00.958863 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.958837 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f6d2ca_c02d_4a07_8f79_72508fb85ca5.slice/crio-799e155c8910b00468df5f2d65cfba926a1f61e217fd815d87d53fe50836cced WatchSource:0}: Error finding container 799e155c8910b00468df5f2d65cfba926a1f61e217fd815d87d53fe50836cced: Status 404 returned error can't find the container with id 799e155c8910b00468df5f2d65cfba926a1f61e217fd815d87d53fe50836cced Jul 24 20:15:00.966408 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.966382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9x9zw" Jul 24 20:15:00.975460 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.975419 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94029bd9_7225_4de9_b477_a42bd882ca7b.slice/crio-aceefcdd07f1af4fca98da1ec322154f2ecfc34385bf2a8c4549235ad3ac98b6 WatchSource:0}: Error finding container aceefcdd07f1af4fca98da1ec322154f2ecfc34385bf2a8c4549235ad3ac98b6: Status 404 returned error can't find the container with id aceefcdd07f1af4fca98da1ec322154f2ecfc34385bf2a8c4549235ad3ac98b6 Jul 24 20:15:00.982471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.982442 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5ngqv" Jul 24 20:15:00.990354 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:00.990319 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed90b0c_7af8_439d_850b_56e570ae6ca9.slice/crio-1711e43180e31bb6cad16c9f6286cbca45d83351e615a910877f86d08649bc51 WatchSource:0}: Error finding container 1711e43180e31bb6cad16c9f6286cbca45d83351e615a910877f86d08649bc51: Status 404 returned error can't find the container with id 1711e43180e31bb6cad16c9f6286cbca45d83351e615a910877f86d08649bc51 Jul 24 20:15:00.996939 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:00.996901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" Jul 24 20:15:01.004956 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:01.004921 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e4e4ba_043f_429b_be04_a8c39f41b4a4.slice/crio-9f61cef3102f069ed4f3e1ed8f0bdd6681a58846aaaf4720861b9135ff9eeb87 WatchSource:0}: Error finding container 9f61cef3102f069ed4f3e1ed8f0bdd6681a58846aaaf4720861b9135ff9eeb87: Status 404 returned error can't find the container with id 9f61cef3102f069ed4f3e1ed8f0bdd6681a58846aaaf4720861b9135ff9eeb87 Jul 24 20:15:01.029267 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.029226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:01.037640 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:01.037602 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93e32ff_ea66_4e5a_8095_e78e658f46a0.slice/crio-3c42e34042ff20909a458636b244f7691cb9cda2bc8aa774567f09518a067c2e WatchSource:0}: Error finding container 3c42e34042ff20909a458636b244f7691cb9cda2bc8aa774567f09518a067c2e: Status 404 returned error can't find the container with id 3c42e34042ff20909a458636b244f7691cb9cda2bc8aa774567f09518a067c2e Jul 24 20:15:01.043128 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.043096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:01.052311 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:01.052278 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631fedfb_b4fb_415d_8654_74769ffe064a.slice/crio-c245097d977d2fe8316e245af65e9012dae6726b9b17f6953edc88c6db5321cc WatchSource:0}: Error finding container c245097d977d2fe8316e245af65e9012dae6726b9b17f6953edc88c6db5321cc: Status 404 returned error can't find the container with id c245097d977d2fe8316e245af65e9012dae6726b9b17f6953edc88c6db5321cc Jul 24 20:15:01.053243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.053220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" Jul 24 20:15:01.055656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.055630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4xdf" Jul 24 20:15:01.062326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.062294 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:01.064751 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:01.064720 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5afadae_f3e4_44ff_9a02_faf337f7bf1e.slice/crio-3bab81d8aa804288a8f22ab16a4ec99f910b55ef321b2b73f95aecef3a838e38 WatchSource:0}: Error finding container 3bab81d8aa804288a8f22ab16a4ec99f910b55ef321b2b73f95aecef3a838e38: Status 404 returned error can't find the container with id 3bab81d8aa804288a8f22ab16a4ec99f910b55ef321b2b73f95aecef3a838e38 Jul 24 20:15:01.067307 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:01.067263 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a1c5ab_32ff_4a25_b82d_e4c8476ec2e9.slice/crio-97c3bf684f911c9ad364322ca6c8658423dc02aee4fb4a555a1f8ec45078b5e2 WatchSource:0}: Error finding container 97c3bf684f911c9ad364322ca6c8658423dc02aee4fb4a555a1f8ec45078b5e2: Status 404 returned error can't find the container with id 97c3bf684f911c9ad364322ca6c8658423dc02aee4fb4a555a1f8ec45078b5e2 Jul 24 20:15:01.237171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.237065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:01.237356 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.237238 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:01.237356 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.237312 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:02.237288427 +0000 UTC m=+3.034881512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:01.338027 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.337991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:01.338241 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.338172 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:01.338308 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.338247 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:02.338231449 +0000 UTC m=+3.135824536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:01.439059 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.439005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:01.439257 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.439193 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:01.439257 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.439222 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:01.439257 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.439237 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:01.439427 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.439308 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:02.439289415 +0000 UTC m=+3.236882511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:01.665617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.665491 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 20:10:00 +0000 UTC" deadline="2028-05-07 15:56:16.47337934 +0000 UTC" Jul 24 20:15:01.665617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.665558 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15667h41m14.807824869s" Jul 24 20:15:01.710490 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.709824 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:01.710490 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:01.709976 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:01.715235 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.715110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmltz" event={"ID":"22f6d2ca-c02d-4a07-8f79-72508fb85ca5","Type":"ContainerStarted","Data":"799e155c8910b00468df5f2d65cfba926a1f61e217fd815d87d53fe50836cced"} Jul 24 20:15:01.719247 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.719138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" event={"ID":"31f200dc5ffa26be918fd14a3d29070f","Type":"ContainerStarted","Data":"04765b94e2fd232e36d54dd4726d9927901f8a6b5a01459d8717d895e829898d"} Jul 24 20:15:01.722569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.722464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" event={"ID":"c5afadae-f3e4-44ff-9a02-faf337f7bf1e","Type":"ContainerStarted","Data":"3bab81d8aa804288a8f22ab16a4ec99f910b55ef321b2b73f95aecef3a838e38"} Jul 24 20:15:01.725279 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.725190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xt42r" event={"ID":"631fedfb-b4fb-415d-8654-74769ffe064a","Type":"ContainerStarted","Data":"c245097d977d2fe8316e245af65e9012dae6726b9b17f6953edc88c6db5321cc"} Jul 24 20:15:01.730115 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.729959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"3c42e34042ff20909a458636b244f7691cb9cda2bc8aa774567f09518a067c2e"} Jul 24 20:15:01.734999 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.734767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9x9zw" event={"ID":"94029bd9-7225-4de9-b477-a42bd882ca7b","Type":"ContainerStarted","Data":"aceefcdd07f1af4fca98da1ec322154f2ecfc34385bf2a8c4549235ad3ac98b6"} Jul 24 20:15:01.744925 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.744618 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:01.750370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.750249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sczr8" event={"ID":"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5","Type":"ContainerStarted","Data":"aaf2630bc5587228bf20564959508cf10cd1b1683569c1f3b68f2343a633081c"} Jul 24 20:15:01.755479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.755390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" event={"ID":"ea9ca707d62b1ca03e80e7064968f8e2","Type":"ContainerStarted","Data":"f7a3bf64ec1b6bc81ed3205305af78bf7dfbdc10398a0c8b29e9d4429e0451d6"} Jul 24 20:15:01.757579 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.757486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4xdf" event={"ID":"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9","Type":"ContainerStarted","Data":"97c3bf684f911c9ad364322ca6c8658423dc02aee4fb4a555a1f8ec45078b5e2"} Jul 24 20:15:01.759619 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.759524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerStarted","Data":"9f61cef3102f069ed4f3e1ed8f0bdd6681a58846aaaf4720861b9135ff9eeb87"} Jul 24 20:15:01.762171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:01.762100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5ngqv" event={"ID":"0ed90b0c-7af8-439d-850b-56e570ae6ca9","Type":"ContainerStarted","Data":"1711e43180e31bb6cad16c9f6286cbca45d83351e615a910877f86d08649bc51"} Jul 24 20:15:02.247115 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.247057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:02.247345 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.247268 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:02.247345 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.247342 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:04.247321418 +0000 UTC m=+5.044914503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:02.348214 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.347583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:02.348214 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.347761 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:02.348214 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.347820 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:04.347803464 +0000 UTC m=+5.145396551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:02.448017 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.447976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:02.448253 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.448196 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:02.448253 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.448216 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:02.448253 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.448228 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:02.448405 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.448288 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:04.448270252 +0000 UTC m=+5.245863335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:02.666200 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.666084 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 20:10:00 +0000 UTC" deadline="2028-03-11 09:03:02.011785726 +0000 UTC" Jul 24 20:15:02.666200 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.666152 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14292h47m59.345637963s" Jul 24 20:15:02.708371 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.708327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:02.708540 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.708471 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:02.708619 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:02.708540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:02.708676 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:02.708655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:03.062946 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:03.062857 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:03.351624 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:03.351508 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 20:15:03.710360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:03.710276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:03.710876 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:03.710424 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:04.267569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:04.267475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:04.267759 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.267648 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:04.267759 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.267720 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:08.267698843 +0000 UTC m=+9.065291947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:04.368116 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:04.368065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:04.368314 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.368286 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:04.368379 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.368354 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:08.368335007 +0000 UTC m=+9.165928091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:04.469120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:04.469081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:04.469311 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.469276 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:04.469311 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.469299 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:04.469415 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.469315 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:04.469415 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.469375 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:08.469355888 +0000 UTC m=+9.266948987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:04.708795 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:04.708701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:04.708985 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.708868 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:04.709353 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:04.709333 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:04.709461 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:04.709438 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:05.710237 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:05.710201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:05.710709 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:05.710334 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:06.708613 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:06.708558 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:06.708789 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:06.708576 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:06.708789 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:06.708721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:06.708902 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:06.708855 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:07.708161 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:07.708113 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:07.708652 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:07.708255 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:08.307193 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:08.307149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:08.307373 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.307344 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:08.307450 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.307434 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:16.307409579 +0000 UTC m=+17.105002683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:08.407921 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:08.407870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:08.408157 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.408017 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:08.408157 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.408114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:16.408092756 +0000 UTC m=+17.205685845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:08.508542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:08.508448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:08.508721 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.508649 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:08.508721 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.508677 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:08.508721 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.508691 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:08.508899 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.508762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:16.508740743 +0000 UTC m=+17.306333830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:08.708551 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:08.708515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:08.709015 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.708678 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:08.709015 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:08.708721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:08.709015 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:08.708847 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:09.708653 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:09.708616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:09.709115 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:09.708734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:10.708564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:10.708520 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:10.708739 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:10.708571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:10.708739 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:10.708669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:10.709244 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:10.708819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:11.708402 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:11.708356 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:11.708622 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:11.708514 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:12.708183 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:12.708141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:12.708705 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:12.708140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:12.708705 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:12.708334 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:12.708705 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:12.708435 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:13.708178 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:13.708138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:13.708373 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:13.708273 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:14.708172 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:14.708127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:14.708172 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:14.708169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:14.708380 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:14.708284 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:14.708674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:14.708403 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:15.707968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:15.707877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:15.708156 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:15.708014 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:16.367026 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:16.366922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:16.367526 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.367107 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:16.367526 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.367183 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:32.367166336 +0000 UTC m=+33.164759419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:16.468087 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:16.468045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:16.468286 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.468261 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:16.468363 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.468350 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:32.468327371 +0000 UTC m=+33.265920458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:16.568711 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:16.568666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:16.568908 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.568878 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:16.568962 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.568911 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:16.568962 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.568922 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:16.571793 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.569224 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:15:32.569199871 +0000 UTC m=+33.366793021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:16.708851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:16.708757 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:16.708851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:16.708799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:16.709108 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.708903 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:16.709108 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:16.709045 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:17.708829 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:17.708785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:17.709333 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:17.708924 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:18.708733 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:18.708688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:18.708937 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:18.708742 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:18.708937 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:18.708810 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:18.709336 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:18.708945 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:19.709388 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:19.709344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:19.709867 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:19.709474 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:20.708676 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.708456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:20.708849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.708502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:20.708849 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:20.708762 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:20.708956 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:20.708853 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:20.804837 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.804744 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="a07dc943cbaaa6244e6827cfbc0e5c12fa25f8574caa840653134861574687df" exitCode=0 Jul 24 20:15:20.805782 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.804840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"a07dc943cbaaa6244e6827cfbc0e5c12fa25f8574caa840653134861574687df"} Jul 24 20:15:20.806654 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.806622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5ngqv" event={"ID":"0ed90b0c-7af8-439d-850b-56e570ae6ca9","Type":"ContainerStarted","Data":"5b09a1f3bbab91bd26184b370a603c5f7be5885cd6d6dc437af434a7837b95b5"} Jul 24 20:15:20.808121 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.808096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmltz" event={"ID":"22f6d2ca-c02d-4a07-8f79-72508fb85ca5","Type":"ContainerStarted","Data":"18b5b9e183e323a064055e36d4b3a064c38b7080517bb431ddd4e6e382bfb3e5"} Jul 24 20:15:20.809660 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.809626 2574 generic.go:356] "Generic (PLEG): container finished" podID="31f200dc5ffa26be918fd14a3d29070f" containerID="bac97c9be03dc4d3b3a56671bce7f97d8e8a55211c0cc368cc7beab88b809e45" exitCode=0 Jul 24 20:15:20.809776 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.809696 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" event={"ID":"31f200dc5ffa26be918fd14a3d29070f","Type":"ContainerDied","Data":"bac97c9be03dc4d3b3a56671bce7f97d8e8a55211c0cc368cc7beab88b809e45"} Jul 24 20:15:20.811357 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.811329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" event={"ID":"c5afadae-f3e4-44ff-9a02-faf337f7bf1e","Type":"ContainerStarted","Data":"5de2856a4883f1bea8b5e3a0db6812afe259157501263d4d68cef65a618b7ca9"} Jul 24 20:15:20.812724 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.812695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xt42r" event={"ID":"631fedfb-b4fb-415d-8654-74769ffe064a","Type":"ContainerStarted","Data":"4a09b46f6556790f4edfb778b45d49af23a73c2c07cb4d9699349e8c0b51d5a9"} Jul 24 20:15:20.814759 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.814734 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"e401bdd6e30829de760189720d3604050acdb4da4a162b8369f2429e1677efeb"} Jul 24 20:15:20.814878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.814813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"1b21f74e530fb14f9f02b1305843193816ef5dcbda0269fdd0b3e7b73f332862"} Jul 24 20:15:20.814878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.814865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"ae18826f1720045a4e883a0cf4ed51185e1ff309fcf205de84fffbf9c29c0416"} Jul 24 20:15:20.816123 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.816096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9x9zw" event={"ID":"94029bd9-7225-4de9-b477-a42bd882ca7b","Type":"ContainerStarted","Data":"697955a32019ef89d9280bfafd49742d1291fa63c00a466f16603bcc9a0d2a19"} Jul 24 20:15:20.817577 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.817547 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sczr8" event={"ID":"c7b9899c-16b3-4f79-baa3-14f95b1bf2e5","Type":"ContainerStarted","Data":"37aab4ab8c1c275477f89c705eda3a0e677b71e4119768b1a6f21d0d506899b9"} Jul 24 20:15:20.819048 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.819027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" event={"ID":"ea9ca707d62b1ca03e80e7064968f8e2","Type":"ContainerStarted","Data":"51baa18c96dcbdb0ff3742e13af3625627e44cfdb13524c42ea993f044968b77"} Jul 24 20:15:20.841437 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.841373 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xt42r" podStartSLOduration=2.833504559 podStartE2EDuration="21.841353903s" totalImagesPullingTime="19.007849344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.841328515 +0000 UTC m=+21.638921619" watchObservedRunningTime="2026-07-24 20:15:20.841353903 +0000 UTC m=+21.638947003" Jul 24 20:15:20.854408 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.854352 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-198.ec2.internal" podStartSLOduration=20.854330904 podStartE2EDuration="20.854330904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.853831067 +0000 UTC m=+21.651424173" watchObservedRunningTime="2026-07-24 20:15:20.854330904 +0000 UTC m=+21.651924009" Jul 24 20:15:20.869765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.869710 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sczr8" podStartSLOduration=2.770494893 podStartE2EDuration="21.86968845s" totalImagesPullingTime="19.099193557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.869479427 +0000 UTC m=+21.667072531" watchObservedRunningTime="2026-07-24 20:15:20.86968845 +0000 UTC m=+21.667281557" Jul 24 20:15:20.883451 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.883391 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9x9zw" podStartSLOduration=6.808885657 podStartE2EDuration="21.883372283s" totalImagesPullingTime="15.074486626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.882952053 +0000 UTC m=+21.680545159" watchObservedRunningTime="2026-07-24 20:15:20.883372283 +0000 UTC m=+21.680965387" Jul 24 20:15:20.906476 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.906423 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5ngqv" podStartSLOduration=2.7133272120000003 podStartE2EDuration="21.906408197s" totalImagesPullingTime="19.193080985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.906049096 +0000 UTC m=+21.703642198" watchObservedRunningTime="2026-07-24 20:15:20.906408197 +0000 UTC m=+21.704001299" Jul 24 20:15:20.935890 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:20.935838 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nmltz" podStartSLOduration=1.842520809 podStartE2EDuration="20.935819907s" totalImagesPullingTime="19.093299098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:20.935708385 +0000 UTC m=+21.733301502" watchObservedRunningTime="2026-07-24 20:15:20.935819907 +0000 UTC m=+21.733413012" Jul 24 20:15:21.211529 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.211235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:21.212224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.212202 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:21.708189 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.708153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:21.708384 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:21.708297 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:21.824847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.824795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"cb0a96a7f77ef2763f5eadaed1268d9abd7d07010eee51f75a62ac23246f0335"} Jul 24 20:15:21.825370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.824900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"2b1d4a53e0768e497807cac7cfeb50c42fc8bdfa5f681b362737ffcd2eb15536"} Jul 24 20:15:21.825370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.824955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"06c84385498a9b03e5c8d71ce52d41a5def31b9d95ce40547db3e75ddff396e5"} Jul 24 20:15:21.826516 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.826484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4xdf" event={"ID":"53a1c5ab-32ff-4a25-b82d-e4c8476ec2e9","Type":"ContainerStarted","Data":"7384836587babc8769695796d6a06b949e872fa04d7d2cb3cb97255154104fc6"} Jul 24 20:15:21.842734 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.842624 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w4xdf" podStartSLOduration=2.857820536 podStartE2EDuration="21.842604574s" totalImagesPullingTime="18.984784038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:21.842000707 +0000 UTC m=+22.639593812" watchObservedRunningTime="2026-07-24 20:15:21.842604574 +0000 UTC m=+22.640197678" Jul 24 20:15:21.927002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.926911 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:21.927625 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:21.927576 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xt42r" Jul 24 20:15:22.161102 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.161045 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 20:15:22.708091 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.708043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:22.708382 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:22.708207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:22.708576 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.708552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:22.708742 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:22.708717 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:22.711476 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.711350 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T20:15:22.161066463Z","UUID":"807f412c-99ab-4da5-be75-7d5275a1c623","Handler":null,"Name":"","Endpoint":""} Jul 24 20:15:22.713780 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.713753 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 20:15:22.713940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.713803 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 20:15:22.831410 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.831371 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" event={"ID":"31f200dc5ffa26be918fd14a3d29070f","Type":"ContainerStarted","Data":"ed0b80da67b95f6b733b121f72f95ec57e2dcd7ef81251989025b6ca808323ae"} Jul 24 20:15:22.833508 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.833473 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" event={"ID":"c5afadae-f3e4-44ff-9a02-faf337f7bf1e","Type":"ContainerStarted","Data":"19e69e5ac8b72a304c09edca3c8703614be3b2cbb42d91df22556f97c6afc0a5"} Jul 24 20:15:22.848537 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:22.848463 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-198.ec2.internal" podStartSLOduration=22.8484405 podStartE2EDuration="22.8484405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:22.847633185 +0000 UTC m=+23.645226290" watchObservedRunningTime="2026-07-24 20:15:22.8484405 +0000 UTC m=+23.646033607" Jul 24 20:15:23.708377 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:23.708346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:23.708532 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:23.708453 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:23.838794 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:23.838757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" event={"ID":"c5afadae-f3e4-44ff-9a02-faf337f7bf1e","Type":"ContainerStarted","Data":"38e6fecc808f3f0ac78e149e10dcf901a964ab3eb25be032b73a1efd3b5b630b"} Jul 24 20:15:23.842923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:23.842887 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"a9fd37c2b67ad1b2595276226e259c5e759e31785d41c41b4a138202776ecadc"} Jul 24 20:15:23.856696 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:23.856631 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4jxw" podStartSLOduration=7.759067818 podStartE2EDuration="24.856612934s" totalImagesPullingTime="17.097545116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:23.856266134 +0000 UTC m=+24.653859257" watchObservedRunningTime="2026-07-24 20:15:23.856612934 +0000 UTC m=+24.654206035" Jul 24 20:15:24.708395 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:24.708357 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:24.708618 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:24.708411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:24.708618 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:24.708506 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:24.708734 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:24.708669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:25.709032 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.708763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:25.709601 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:25.709200 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:25.851430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.851393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" event={"ID":"a93e32ff-ea66-4e5a-8095-e78e658f46a0","Type":"ContainerStarted","Data":"5254893a8cd4d0e69acbdfafd9680e9de540bc02ecc3639d03a607ea4cccb4c9"} Jul 24 20:15:25.851640 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.851618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:25.851743 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.851697 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:25.853459 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.853428 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="faf71349bbcddf6bcf79792592d05c99eb2663a04b19862eeacba96ce8157085" exitCode=0 Jul 24 20:15:25.853583 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.853478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"faf71349bbcddf6bcf79792592d05c99eb2663a04b19862eeacba96ce8157085"} Jul 24 20:15:25.868261 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.868235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:25.877551 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:25.877498 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" podStartSLOduration=7.605724016 podStartE2EDuration="26.877483217s" totalImagesPullingTime="19.271759201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:25.87660258 +0000 UTC m=+26.674195677" watchObservedRunningTime="2026-07-24 20:15:25.877483217 +0000 UTC m=+26.675076321" Jul 24 20:15:26.709945 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:26.709827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:26.710634 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:26.709995 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:26.710634 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:26.710046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:26.710634 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:26.710175 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:26.856248 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:26.856214 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:26.873269 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:26.873239 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:27.708626 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.708579 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:27.708819 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:27.708697 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:27.728500 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.728466 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2lvf"] Jul 24 20:15:27.729049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.728601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:27.729049 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:27.728695 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:27.731845 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.731806 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x7rw"] Jul 24 20:15:27.732052 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.731970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:27.732138 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:27.732118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:27.732572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.732542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28d2d"] Jul 24 20:15:27.860439 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.860407 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="646400cb31384464df14752244c9bff79a2986520bfae27e0fdf5ed67f7593b1" exitCode=0 Jul 24 20:15:27.860663 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.860496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:27.860663 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:27.860490 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"646400cb31384464df14752244c9bff79a2986520bfae27e0fdf5ed67f7593b1"} Jul 24 20:15:27.860802 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:27.860775 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:29.709375 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:29.709176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:29.709763 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:29.709252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:29.709763 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:29.709437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:29.709763 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:29.709268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:29.709763 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:29.709529 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:29.709763 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:29.709606 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:29.867437 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:29.867390 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="6661ab8192230d04e36f423b9260be810ac12e0cb56193b7eb1b0cf020a1e76b" exitCode=0 Jul 24 20:15:29.867617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:29.867487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"6661ab8192230d04e36f423b9260be810ac12e0cb56193b7eb1b0cf020a1e76b"} Jul 24 20:15:31.708534 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:31.708493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:31.709099 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:31.708493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:31.709099 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:31.708667 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:31.709099 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:31.708493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:31.709099 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:31.708739 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:31.709099 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:31.708802 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:32.387706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:32.387673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:32.387912 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.387819 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:32.387912 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.387881 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:04.387864044 +0000 UTC m=+65.185457139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 20:15:32.488819 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:32.488781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:32.488994 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.488908 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:32.488994 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.488959 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret podName:43a29076-4718-4bf1-af6c-dc8ce087247f nodeName:}" failed. No retries permitted until 2026-07-24 20:16:04.488945544 +0000 UTC m=+65.286538627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret") pod "global-pull-secret-syncer-k2lvf" (UID: "43a29076-4718-4bf1-af6c-dc8ce087247f") : object "kube-system"/"original-pull-secret" not registered Jul 24 20:15:32.589857 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:32.589819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:32.590041 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.589988 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 20:15:32.590041 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.590016 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 20:15:32.590041 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.590026 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hhqrk for pod openshift-network-diagnostics/network-check-target-28d2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:32.590195 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:32.590110 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk podName:c4e3e0ad-e090-469f-bb63-a7a116f3204f nodeName:}" failed. No retries permitted until 2026-07-24 20:16:04.590090257 +0000 UTC m=+65.387683375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhqrk" (UniqueName: "kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk") pod "network-check-target-28d2d" (UID: "c4e3e0ad-e090-469f-bb63-a7a116f3204f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 20:15:33.708722 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:33.708685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:33.708722 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:33.708718 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:33.709291 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:33.708685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:33.709291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:33.708836 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k2lvf" podUID="43a29076-4718-4bf1-af6c-dc8ce087247f" Jul 24 20:15:33.709291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:33.708937 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x7rw" podUID="409918d3-b2da-4844-a3f8-c341604c02f6" Jul 24 20:15:33.709291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:33.709021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28d2d" podUID="c4e3e0ad-e090-469f-bb63-a7a116f3204f" Jul 24 20:15:33.985171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:33.985129 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-198.ec2.internal" event="NodeReady" Jul 24 20:15:33.985339 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:33.985325 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 20:15:34.019000 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.018661 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:15:34.021659 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.021474 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.024604 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.024564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 20:15:34.024604 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.024588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 20:15:34.024604 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.024596 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 20:15:34.024854 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.024643 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpp76\"" Jul 24 20:15:34.031660 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.031636 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 20:15:34.033156 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.033133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ttvpd"] Jul 24 20:15:34.035455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.035435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.037064 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.037045 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:15:34.038143 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.038122 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 20:15:34.038246 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.038151 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 20:15:34.038246 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.038211 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mgpkh\"" Jul 24 20:15:34.040147 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.040124 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xzchh"] Jul 24 20:15:34.042171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.042153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.044700 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.044682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 20:15:34.044807 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.044721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p92ks\"" Jul 24 20:15:34.044807 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.044798 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 20:15:34.045227 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.045046 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 20:15:34.046520 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.046500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttvpd"] Jul 24 20:15:34.053699 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.053611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzchh"] Jul 24 20:15:34.103008 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.102983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.103104 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103156 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103195 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbncz\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103227 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103263 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103296 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103329 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-config-volume\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.103360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55cnj\" (UniqueName: \"kubernetes.io/projected/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-kube-api-access-55cnj\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.103423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.103423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.103396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-tmp-dir\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.203927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.203889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.203935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbncz\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmxg\" (UniqueName: \"kubernetes.io/projected/1723737e-ee40-45e4-8557-0c2eec6c5586-kube-api-access-dkmxg\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.204278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-config-volume\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.204490 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55cnj\" (UniqueName: \"kubernetes.io/projected/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-kube-api-access-55cnj\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.204693 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-tmp-dir\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.204818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1723737e-ee40-45e4-8557-0c2eec6c5586-cert\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.204818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204748 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.204818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.204779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.205125 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.204972 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:34.205125 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.205017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.205125 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.205093 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:34.705059435 +0000 UTC m=+35.502652519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:34.205125 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.205109 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:34.205125 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.205120 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:34.205310 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.205159 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:34.705143233 +0000 UTC m=+35.502736317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:34.205473 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.205453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-tmp-dir\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.205533 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.205514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-config-volume\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.205614 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.205599 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.208616 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.208590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.208616 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.208615 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.214414 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.214382 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.214585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.214566 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55cnj\" (UniqueName: \"kubernetes.io/projected/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-kube-api-access-55cnj\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.214863 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.214838 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbncz\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.288060 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.288019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:34.306029 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.305986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmxg\" (UniqueName: \"kubernetes.io/projected/1723737e-ee40-45e4-8557-0c2eec6c5586-kube-api-access-dkmxg\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.306243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.306146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1723737e-ee40-45e4-8557-0c2eec6c5586-cert\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.308627 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.308606 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1723737e-ee40-45e4-8557-0c2eec6c5586-cert\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.315862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.315833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmxg\" (UniqueName: \"kubernetes.io/projected/1723737e-ee40-45e4-8557-0c2eec6c5586-kube-api-access-dkmxg\") pod \"ingress-canary-xzchh\" (UID: \"1723737e-ee40-45e4-8557-0c2eec6c5586\") " pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.375207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.375174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzchh" Jul 24 20:15:34.399925 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.399890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:34.468678 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.468574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:34.524037 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.523911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzchh"] Jul 24 20:15:34.530198 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:34.530171 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1723737e_ee40_45e4_8557_0c2eec6c5586.slice/crio-8e291c86a6630405f0a503d1f0296d8de7b9234648b2d3ebffb45d21686525df WatchSource:0}: Error finding container 8e291c86a6630405f0a503d1f0296d8de7b9234648b2d3ebffb45d21686525df: Status 404 returned error can't find the container with id 8e291c86a6630405f0a503d1f0296d8de7b9234648b2d3ebffb45d21686525df Jul 24 20:15:34.567419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.567323 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:34.709477 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.709442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.709490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.709609 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.709611 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.709631 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.709665 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:35.709649845 +0000 UTC m=+36.507242941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:34.710408 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:34.709679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:35.70967313 +0000 UTC m=+36.507266214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:34.881409 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.881318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzchh" event={"ID":"1723737e-ee40-45e4-8557-0c2eec6c5586","Type":"ContainerStarted","Data":"8e291c86a6630405f0a503d1f0296d8de7b9234648b2d3ebffb45d21686525df"} Jul 24 20:15:34.884085 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.884037 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="986557848ed39eb4e8950de8eca9dbae922f362fc3598b2220d50ac955b08598" exitCode=0 Jul 24 20:15:34.884221 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:34.884088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"986557848ed39eb4e8950de8eca9dbae922f362fc3598b2220d50ac955b08598"} Jul 24 20:15:35.250694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.250604 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:35.336694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.336660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:35.637982 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.637947 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:35.699699 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.699663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:35.708654 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.708621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:15:35.708843 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.708656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:15:35.708843 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.708626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:15:35.711465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.711433 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 20:15:35.713088 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.713047 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 20:15:35.713088 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.713068 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 20:15:35.713293 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.713186 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8xdt\"" Jul 24 20:15:35.713293 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.713240 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 20:15:35.713293 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.713282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2sm2r\"" Jul 24 20:15:35.718215 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.718188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:35.718366 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.718314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:35.718440 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:35.718363 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:35.718440 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:35.718423 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:37.71840289 +0000 UTC m=+38.515995975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:35.718551 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:35.718436 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:35.718551 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:35.718459 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:35.718551 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:35.718514 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:37.718494953 +0000 UTC m=+38.516088050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:35.891043 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.890721 2574 generic.go:356] "Generic (PLEG): container finished" podID="95e4e4ba-043f-429b-be04-a8c39f41b4a4" containerID="1ee015c31084287cc0c5a1540788489dbf36ae94d298ddfe216ace4b5ddb86a3" exitCode=0 Jul 24 20:15:35.891043 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:35.890840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerDied","Data":"1ee015c31084287cc0c5a1540788489dbf36ae94d298ddfe216ace4b5ddb86a3"} Jul 24 20:15:36.896785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:36.896751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" event={"ID":"95e4e4ba-043f-429b-be04-a8c39f41b4a4","Type":"ContainerStarted","Data":"6cd106b3dcffd9472f8a93a41bf74a222d36b02cfff0535bbd01107490f0112a"} Jul 24 20:15:36.923360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:36.923305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fhzs" podStartSLOduration=7.8549636849999995 podStartE2EDuration="37.923286589s" totalImagesPullingTime="30.068322904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:36.921490202 +0000 UTC m=+37.719083300" watchObservedRunningTime="2026-07-24 20:15:36.923286589 +0000 UTC m=+37.720879693" Jul 24 20:15:37.046765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.046727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:37.147056 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.146962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:37.415845 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.415762 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:37.488772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.488738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" limit=1024 Jul 24 20:15:37.737850 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.737755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:37.737850 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.737804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:37.738033 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:37.737938 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:37.738033 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:37.737958 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:37.738033 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:37.738015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:41.737999478 +0000 UTC m=+42.535592561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:37.738161 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:37.738035 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:37.738161 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:37.738108 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:41.738091173 +0000 UTC m=+42.535684272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:37.900153 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.900115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzchh" event={"ID":"1723737e-ee40-45e4-8557-0c2eec6c5586","Type":"ContainerStarted","Data":"a2327e44f00512b9d40961b899c2d0b5eb0338e45bf63d1406afd0565ac8ffd9"} Jul 24 20:15:37.935333 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:37.935279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xzchh" podStartSLOduration=1.3273649330000001 podStartE2EDuration="3.93526437s" totalImagesPullingTime="2.607899437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:37.93365694 +0000 UTC m=+38.731250047" watchObservedRunningTime="2026-07-24 20:15:37.93526437 +0000 UTC m=+38.732857512" Jul 24 20:15:41.767641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:41.767593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:41.767711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:41.767756 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:41.767830 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:49.767812774 +0000 UTC m=+50.565405874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:41.767834 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:41.767849 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:41.768155 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:41.767899 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:49.767882831 +0000 UTC m=+50.565475915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:49.439023 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.438983 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7"] Jul 24 20:15:49.446047 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.446003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r7vws"] Jul 24 20:15:49.446229 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.446159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.449068 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.449044 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.449233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.449067 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 20:15:49.449233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.449104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 20:15:49.449233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.449104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.449233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.449166 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h85mc\"" Jul 24 20:15:49.463716 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.463685 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7"] Jul 24 20:15:49.463880 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.463727 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r7vws"] Jul 24 20:15:49.463880 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.463801 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.466688 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.466660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.466688 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.466681 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.466919 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.466901 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 20:15:49.466979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.466934 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 20:15:49.466979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.466950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7gcbh\"" Jul 24 20:15:49.473683 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.473654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 20:15:49.554325 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.554283 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq"] Jul 24 20:15:49.565235 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.565199 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf"] Jul 24 20:15:49.565406 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.565344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.569461 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.569430 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.569461 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.569452 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.570523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.570473 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dgdwk\"" Jul 24 20:15:49.570732 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.570692 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 20:15:49.572186 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.572165 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 20:15:49.576348 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.576325 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq"] Jul 24 20:15:49.576474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.576356 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fffc66b69-rfwq8"] Jul 24 20:15:49.576474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.576440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" Jul 24 20:15:49.579575 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.579550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.579898 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.579882 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.579940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.579886 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8hmxq\"" Jul 24 20:15:49.589537 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.589463 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f"] Jul 24 20:15:49.590437 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.589834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593433 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593491 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593833 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nn2sp\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593909 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.594004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.593978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.602572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.602541 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l"] Jul 24 20:15:49.602728 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.602654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.606041 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.605976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.606041 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.606020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cr45z\"" Jul 24 20:15:49.606275 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.605976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 20:15:49.606275 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.606185 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.615047 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.615008 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf"] Jul 24 20:15:49.615047 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.615050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f"] Jul 24 20:15:49.615271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.615108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fffc66b69-rfwq8"] Jul 24 20:15:49.615271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.615131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l"] Jul 24 20:15:49.615271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.615148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" Jul 24 20:15:49.618255 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.618232 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tvgxt\"" Jul 24 20:15:49.631713 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa746c21-3c68-4052-92e3-cf9a82ed9aea-config\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.631713 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-serving-cert\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.631970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-trusted-ca\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.631970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa746c21-3c68-4052-92e3-cf9a82ed9aea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.631970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckxq\" (UniqueName: \"kubernetes.io/projected/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-kube-api-access-cckxq\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.631970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.631943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-config\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.632169 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.632002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbq55\" (UniqueName: \"kubernetes.io/projected/fa746c21-3c68-4052-92e3-cf9a82ed9aea-kube-api-access-jbq55\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.647953 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.647921 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ldwlf"] Jul 24 20:15:49.663190 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.663155 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx"] Jul 24 20:15:49.663386 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.663299 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.667929 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.667899 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 20:15:49.668173 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.667902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.668258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.667899 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.668349 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.668002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-n688n\"" Jul 24 20:15:49.668454 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.668163 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 20:15:49.673726 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.673696 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 20:15:49.674192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.674171 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw"] Jul 24 20:15:49.674331 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.674312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.678619 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.678591 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 20:15:49.679123 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.679104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:49.679275 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.679141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 20:15:49.679392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.679143 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mmm5m\"" Jul 24 20:15:49.679392 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.679156 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 20:15:49.691675 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.691599 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ldwlf"] Jul 24 20:15:49.691675 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.691643 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw"] Jul 24 20:15:49.691675 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.691666 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx"] Jul 24 20:15:49.691888 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.691723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.700755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.700728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tbdhh\"" Jul 24 20:15:49.700755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.700752 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 20:15:49.700952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.700802 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 20:15:49.733136 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-config\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.733315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8jd\" (UniqueName: \"kubernetes.io/projected/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-kube-api-access-5g8jd\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.733315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbq55\" (UniqueName: \"kubernetes.io/projected/fa746c21-3c68-4052-92e3-cf9a82ed9aea-kube-api-access-jbq55\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.733315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-trusted-ca\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.733430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-stats-auth\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.733430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4d8\" (UniqueName: \"kubernetes.io/projected/8409bf8a-5b16-4375-b751-5faadc49d8f0-kube-api-access-2w4d8\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.733430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-default-certificate\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.733430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.733430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z68d\" (UniqueName: \"kubernetes.io/projected/77bdc938-890a-40c1-99e7-12513dfc01dd-kube-api-access-5z68d\") pod \"volume-data-source-validator-549c6d54cf-vtcnf\" (UID: \"77bdc938-890a-40c1-99e7-12513dfc01dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx68z\" (UniqueName: \"kubernetes.io/projected/84e0b606-e6e3-4b9a-a0c4-784472ec351e-kube-api-access-qx68z\") pod \"network-check-source-7d88cb55d8-q7w4l\" (UID: \"84e0b606-e6e3-4b9a-a0c4-784472ec351e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckxq\" (UniqueName: \"kubernetes.io/projected/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-kube-api-access-cckxq\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-serving-cert\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa746c21-3c68-4052-92e3-cf9a82ed9aea-config\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.733793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm2gx\" (UniqueName: \"kubernetes.io/projected/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-kube-api-access-bm2gx\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.734220 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.733968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa746c21-3c68-4052-92e3-cf9a82ed9aea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.734220 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.734030 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-config\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.734220 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.734109 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-trusted-ca\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.734351 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.734303 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa746c21-3c68-4052-92e3-cf9a82ed9aea-config\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.737524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.737497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa746c21-3c68-4052-92e3-cf9a82ed9aea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.737524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.737510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-serving-cert\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.749135 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.749099 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckxq\" (UniqueName: \"kubernetes.io/projected/d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678-kube-api-access-cckxq\") pod \"console-operator-584dcb6b54-r7vws\" (UID: \"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678\") " pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.758095 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.758056 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbq55\" (UniqueName: \"kubernetes.io/projected/fa746c21-3c68-4052-92e3-cf9a82ed9aea-kube-api-access-jbq55\") pod \"service-ca-operator-5d6c75f84f-hkvd7\" (UID: \"fa746c21-3c68-4052-92e3-cf9a82ed9aea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.759847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.759827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" Jul 24 20:15:49.773299 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.773266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z68d\" (UniqueName: \"kubernetes.io/projected/77bdc938-890a-40c1-99e7-12513dfc01dd-kube-api-access-5z68d\") pod \"volume-data-source-validator-549c6d54cf-vtcnf\" (UID: \"77bdc938-890a-40c1-99e7-12513dfc01dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx68z\" (UniqueName: \"kubernetes.io/projected/84e0b606-e6e3-4b9a-a0c4-784472ec351e-kube-api-access-qx68z\") pod \"network-check-source-7d88cb55d8-q7w4l\" (UID: \"84e0b606-e6e3-4b9a-a0c4-784472ec351e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:15:49.836485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.836970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.836513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.836970 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.836710 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.837678 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.837772 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.837784 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-596b4c7f86-xdgzj: secret "image-registry-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.837859 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.838029 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:50.33799656 +0000 UTC m=+51.135589651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.838103 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:50.338089268 +0000 UTC m=+51.135682363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.838130 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls podName:8409bf8a-5b16-4375-b751-5faadc49d8f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:50.338116492 +0000 UTC m=+51.135709589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls") pod "cluster-samples-operator-6748489656-xh82f" (UID: "8409bf8a-5b16-4375-b751-5faadc49d8f0") : secret "samples-operator-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.838147 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls podName:2154160c-0ec9-4b46-865a-0bcc882e00c1 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.838137708 +0000 UTC m=+66.635730838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls") pod "image-registry-596b4c7f86-xdgzj" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1") : secret "image-registry-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.838162 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls podName:1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.838154457 +0000 UTC m=+66.635747555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls") pod "dns-default-ttvpd" (UID: "1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0") : secret "dns-default-metrics-tls" not found Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm2gx\" (UniqueName: \"kubernetes.io/projected/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-kube-api-access-bm2gx\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-service-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-tmp\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0503f3e-709c-4ff4-a09c-268dca991206-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.838760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d3981a-71a9-4c3f-86ab-69c993f65fce-serving-cert\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8jd\" (UniqueName: \"kubernetes.io/projected/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-kube-api-access-5g8jd\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89f2q\" (UniqueName: \"kubernetes.io/projected/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-kube-api-access-89f2q\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-stats-auth\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kmgr\" (UniqueName: \"kubernetes.io/projected/69d3981a-71a9-4c3f-86ab-69c993f65fce-kube-api-access-7kmgr\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4d8\" (UniqueName: \"kubernetes.io/projected/8409bf8a-5b16-4375-b751-5faadc49d8f0-kube-api-access-2w4d8\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-snapshots\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-default-certificate\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.838682 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.839193 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:15:49.839645 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.839246 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:50.339228139 +0000 UTC m=+51.136821236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:15:49.841806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.841782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-stats-auth\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.842272 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.842251 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-default-certificate\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.851450 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.849963 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx68z\" (UniqueName: \"kubernetes.io/projected/84e0b606-e6e3-4b9a-a0c4-784472ec351e-kube-api-access-qx68z\") pod \"network-check-source-7d88cb55d8-q7w4l\" (UID: \"84e0b606-e6e3-4b9a-a0c4-784472ec351e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" Jul 24 20:15:49.853545 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.853473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4d8\" (UniqueName: \"kubernetes.io/projected/8409bf8a-5b16-4375-b751-5faadc49d8f0-kube-api-access-2w4d8\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:49.858852 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.858777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z68d\" (UniqueName: \"kubernetes.io/projected/77bdc938-890a-40c1-99e7-12513dfc01dd-kube-api-access-5z68d\") pod \"volume-data-source-validator-549c6d54cf-vtcnf\" (UID: \"77bdc938-890a-40c1-99e7-12513dfc01dd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" Jul 24 20:15:49.859737 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.859593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm2gx\" (UniqueName: \"kubernetes.io/projected/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-kube-api-access-bm2gx\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:49.861405 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.861348 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8jd\" (UniqueName: \"kubernetes.io/projected/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-kube-api-access-5g8jd\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:49.884686 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.884649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" Jul 24 20:15:49.923956 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.923916 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" Jul 24 20:15:49.931018 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.930982 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7"] Jul 24 20:15:49.934045 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:49.934017 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa746c21_3c68_4052_92e3_cf9a82ed9aea.slice/crio-e3a413668af426b86c371f58ccf417b28a9777faa3edc2ca227bfd2ba8fc06b4 WatchSource:0}: Error finding container e3a413668af426b86c371f58ccf417b28a9777faa3edc2ca227bfd2ba8fc06b4: Status 404 returned error can't find the container with id e3a413668af426b86c371f58ccf417b28a9777faa3edc2ca227bfd2ba8fc06b4 Jul 24 20:15:49.939035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.939172 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-service-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.939172 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-tmp\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.939248 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0503f3e-709c-4ff4-a09c-268dca991206-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d3981a-71a9-4c3f-86ab-69c993f65fce-serving-cert\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89f2q\" (UniqueName: \"kubernetes.io/projected/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-kube-api-access-89f2q\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kmgr\" (UniqueName: \"kubernetes.io/projected/69d3981a-71a9-4c3f-86ab-69c993f65fce-kube-api-access-7kmgr\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-snapshots\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.939903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.940643 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-tmp\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.940748 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.940664 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.941322 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.940770 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.941380 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.941318 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.941435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.941486 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0503f3e-709c-4ff4-a09c-268dca991206-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.941611 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/69d3981a-71a9-4c3f-86ab-69c993f65fce-snapshots\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:49.942503 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:50.44247109 +0000 UTC m=+51.240064189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.943380 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d3981a-71a9-4c3f-86ab-69c993f65fce-serving-cert\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.943612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.943524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69d3981a-71a9-4c3f-86ab-69c993f65fce-service-ca-bundle\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.947188 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.946312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.947484 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.947454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r7vws"] Jul 24 20:15:49.950827 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.950796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kmgr\" (UniqueName: \"kubernetes.io/projected/69d3981a-71a9-4c3f-86ab-69c993f65fce-kube-api-access-7kmgr\") pod \"insights-operator-5885fdb759-ldwlf\" (UID: \"69d3981a-71a9-4c3f-86ab-69c993f65fce\") " pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.951298 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:49.951269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e82ce2_3cf3_45ce_a52b_1aefb8bb0678.slice/crio-a329de1d70ee7e6ead2a9813113aa41a200c6c8707d34764c6cdae420139e400 WatchSource:0}: Error finding container a329de1d70ee7e6ead2a9813113aa41a200c6c8707d34764c6cdae420139e400: Status 404 returned error can't find the container with id a329de1d70ee7e6ead2a9813113aa41a200c6c8707d34764c6cdae420139e400 Jul 24 20:15:49.951465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.951443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89f2q\" (UniqueName: \"kubernetes.io/projected/afe6cb3c-3c98-4782-b4ea-82ffb4de97cf-kube-api-access-89f2q\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx\" (UID: \"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:49.976002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.975877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" Jul 24 20:15:49.983043 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:49.983010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" Jul 24 20:15:50.061607 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.061568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf"] Jul 24 20:15:50.065626 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:50.065593 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bdc938_890a_40c1_99e7_12513dfc01dd.slice/crio-53835287a5de4121c0e357b6b71d5a9bdd53c0776d50a7c06e99d27988b7d25f WatchSource:0}: Error finding container 53835287a5de4121c0e357b6b71d5a9bdd53c0776d50a7c06e99d27988b7d25f: Status 404 returned error can't find the container with id 53835287a5de4121c0e357b6b71d5a9bdd53c0776d50a7c06e99d27988b7d25f Jul 24 20:15:50.095045 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.094991 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l"] Jul 24 20:15:50.099841 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:50.099793 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e0b606_e6e3_4b9a_a0c4_784472ec351e.slice/crio-c51448fc98107696e3fe4353de49934608c73e2200daff9934f807c68abcb335 WatchSource:0}: Error finding container c51448fc98107696e3fe4353de49934608c73e2200daff9934f807c68abcb335: Status 404 returned error can't find the container with id c51448fc98107696e3fe4353de49934608c73e2200daff9934f807c68abcb335 Jul 24 20:15:50.166363 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.166325 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ldwlf"] Jul 24 20:15:50.169222 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:50.169195 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d3981a_71a9_4c3f_86ab_69c993f65fce.slice/crio-43455d0e7571c22d2ada519fcdde2b4afc8ca10b78c93d92da6fca1c36092d63 WatchSource:0}: Error finding container 43455d0e7571c22d2ada519fcdde2b4afc8ca10b78c93d92da6fca1c36092d63: Status 404 returned error can't find the container with id 43455d0e7571c22d2ada519fcdde2b4afc8ca10b78c93d92da6fca1c36092d63 Jul 24 20:15:50.182710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.182676 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx"] Jul 24 20:15:50.186068 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:50.186040 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe6cb3c_3c98_4782_b4ea_82ffb4de97cf.slice/crio-a14c7099af8a8cfd9ffe969e4a9d589a1278ff44af140315d02f6689bcb1998e WatchSource:0}: Error finding container a14c7099af8a8cfd9ffe969e4a9d589a1278ff44af140315d02f6689bcb1998e: Status 404 returned error can't find the container with id a14c7099af8a8cfd9ffe969e4a9d589a1278ff44af140315d02f6689bcb1998e Jul 24 20:15:50.345023 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.344989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:50.345023 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.345028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:50.345291 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.345056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:50.345291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345164 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:15:50.345291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345197 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:51.345177635 +0000 UTC m=+52.142770727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:15:50.345291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345223 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:51.34520852 +0000 UTC m=+52.142801603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:15:50.345291 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345270 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:50.345486 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345315 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:51.345302288 +0000 UTC m=+52.142895388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:50.345486 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.345337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:50.345554 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345495 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 20:15:50.345554 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.345531 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls podName:8409bf8a-5b16-4375-b751-5faadc49d8f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:51.34552283 +0000 UTC m=+52.143115914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls") pod "cluster-samples-operator-6748489656-xh82f" (UID: "8409bf8a-5b16-4375-b751-5faadc49d8f0") : secret "samples-operator-tls" not found Jul 24 20:15:50.446532 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.446490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:50.446984 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.446672 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:15:50.446984 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:50.446769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:51.446746487 +0000 UTC m=+52.244339577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:15:50.936275 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.936224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" event={"ID":"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf","Type":"ContainerStarted","Data":"a14c7099af8a8cfd9ffe969e4a9d589a1278ff44af140315d02f6689bcb1998e"} Jul 24 20:15:50.937896 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.937859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" event={"ID":"69d3981a-71a9-4c3f-86ab-69c993f65fce","Type":"ContainerStarted","Data":"43455d0e7571c22d2ada519fcdde2b4afc8ca10b78c93d92da6fca1c36092d63"} Jul 24 20:15:50.943481 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.943439 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" event={"ID":"84e0b606-e6e3-4b9a-a0c4-784472ec351e","Type":"ContainerStarted","Data":"c51448fc98107696e3fe4353de49934608c73e2200daff9934f807c68abcb335"} Jul 24 20:15:50.949547 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.949437 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" event={"ID":"77bdc938-890a-40c1-99e7-12513dfc01dd","Type":"ContainerStarted","Data":"53835287a5de4121c0e357b6b71d5a9bdd53c0776d50a7c06e99d27988b7d25f"} Jul 24 20:15:50.952905 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.952793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" event={"ID":"fa746c21-3c68-4052-92e3-cf9a82ed9aea","Type":"ContainerStarted","Data":"e3a413668af426b86c371f58ccf417b28a9777faa3edc2ca227bfd2ba8fc06b4"} Jul 24 20:15:50.955639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:50.955566 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" event={"ID":"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678","Type":"ContainerStarted","Data":"a329de1d70ee7e6ead2a9813113aa41a200c6c8707d34764c6cdae420139e400"} Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:51.356232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:51.356284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:51.356319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:51.356364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.356522 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.356589 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls podName:8409bf8a-5b16-4375-b751-5faadc49d8f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:53.356569063 +0000 UTC m=+54.154162159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls") pod "cluster-samples-operator-6748489656-xh82f" (UID: "8409bf8a-5b16-4375-b751-5faadc49d8f0") : secret "samples-operator-tls" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.357025 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.357093 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:53.357061634 +0000 UTC m=+54.154654723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.357153 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.357201 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:53.357189257 +0000 UTC m=+54.154782358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:51.357307 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.357265 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:53.357254093 +0000 UTC m=+54.154847180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:15:51.458430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:51.457572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:51.458430 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.457958 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:15:51.458430 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:51.458031 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:53.458010898 +0000 UTC m=+54.255603988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:15:53.378741 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:53.378696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.378886 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:53.378889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.378972 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls podName:8409bf8a-5b16-4375-b751-5faadc49d8f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:57.378949529 +0000 UTC m=+58.176542635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls") pod "cluster-samples-operator-6748489656-xh82f" (UID: "8409bf8a-5b16-4375-b751-5faadc49d8f0") : secret "samples-operator-tls" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.378992 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:53.379019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.379045 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:57.379029109 +0000 UTC m=+58.176622193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:53.379094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.379107 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.379145 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:57.379132896 +0000 UTC m=+58.176725995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:53.379355 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.379207 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:15:57.379196079 +0000 UTC m=+58.176789165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:15:53.480397 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:53.480357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:53.480604 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.480538 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:15:53.480682 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:53.480617 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:57.480595852 +0000 UTC m=+58.278188935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:15:55.974365 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.974325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" event={"ID":"69d3981a-71a9-4c3f-86ab-69c993f65fce","Type":"ContainerStarted","Data":"35d75cf9ad7db459960cbee556892f939ab230d5de3e222819fc4272fcc4a79a"} Jul 24 20:15:55.976548 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.976111 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" event={"ID":"84e0b606-e6e3-4b9a-a0c4-784472ec351e","Type":"ContainerStarted","Data":"cc45bcc4fe721155134f9883db47acafb4fdca84861c2b9aee1396f7aae521d8"} Jul 24 20:15:55.977761 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.977704 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" event={"ID":"77bdc938-890a-40c1-99e7-12513dfc01dd","Type":"ContainerStarted","Data":"5433b308f7575e5680fd0ca427278cbf914f055e421494bfab3a611b063de9e5"} Jul 24 20:15:55.979404 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.979375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" event={"ID":"fa746c21-3c68-4052-92e3-cf9a82ed9aea","Type":"ContainerStarted","Data":"9ad0c6621a671d2727d11058ebbffa848f3ffb38bd0298c151766263e2f63272"} Jul 24 20:15:55.981179 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.981159 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/0.log" Jul 24 20:15:55.981278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.981193 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" containerID="c613801e876bd011dd01d9f0385173f387bdf2ec2b56eb1045ae6a8d7b21caaf" exitCode=255 Jul 24 20:15:55.981278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.981221 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" event={"ID":"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678","Type":"ContainerDied","Data":"c613801e876bd011dd01d9f0385173f387bdf2ec2b56eb1045ae6a8d7b21caaf"} Jul 24 20:15:55.981469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.981453 2574 scope.go:117] "RemoveContainer" containerID="c613801e876bd011dd01d9f0385173f387bdf2ec2b56eb1045ae6a8d7b21caaf" Jul 24 20:15:55.983107 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.983062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" event={"ID":"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf","Type":"ContainerStarted","Data":"5e5b566b1f862c3f8a56c260e8674e57d0dcf8a97da8680cbf189be57fd70490"} Jul 24 20:15:55.991929 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:55.991882 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" podStartSLOduration=2.179862922 podStartE2EDuration="6.991866379s" totalImagesPullingTime="4.812003457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:55.990505589 +0000 UTC m=+56.788098695" watchObservedRunningTime="2026-07-24 20:15:55.991866379 +0000 UTC m=+56.789459462" Jul 24 20:15:56.007135 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.007053 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" podStartSLOduration=1.960155956 podStartE2EDuration="7.007030808s" totalImagesPullingTime="5.046874852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:56.006367717 +0000 UTC m=+56.803960822" watchObservedRunningTime="2026-07-24 20:15:56.007030808 +0000 UTC m=+56.804623913" Jul 24 20:15:56.052219 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.052167 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vtcnf" podStartSLOduration=2.156555743 podStartE2EDuration="7.052147642s" totalImagesPullingTime="4.895591899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:56.050508154 +0000 UTC m=+56.848101284" watchObservedRunningTime="2026-07-24 20:15:56.052147642 +0000 UTC m=+56.849740747" Jul 24 20:15:56.070140 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.069310 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" podStartSLOduration=2.274396103 podStartE2EDuration="7.069286226s" totalImagesPullingTime="4.794890123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:56.068419852 +0000 UTC m=+56.866012958" watchObservedRunningTime="2026-07-24 20:15:56.069286226 +0000 UTC m=+56.866879333" Jul 24 20:15:56.088826 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.088770 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q7w4l" podStartSLOduration=2.192208429 podStartE2EDuration="7.088753268s" totalImagesPullingTime="4.896544839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:56.087971795 +0000 UTC m=+56.885564901" watchObservedRunningTime="2026-07-24 20:15:56.088753268 +0000 UTC m=+56.886346372" Jul 24 20:15:56.485566 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.485528 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn"] Jul 24 20:15:56.487791 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.487769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" Jul 24 20:15:56.491025 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.490994 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 20:15:56.491209 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.490993 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 20:15:56.491315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.491293 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2vct2\"" Jul 24 20:15:56.498726 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.498698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn"] Jul 24 20:15:56.611473 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.611429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9f2x\" (UniqueName: \"kubernetes.io/projected/76418493-0e91-46b8-9bf4-130eadd3ecbb-kube-api-access-b9f2x\") pod \"migrator-6865c9967-8gpjn\" (UID: \"76418493-0e91-46b8-9bf4-130eadd3ecbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" Jul 24 20:15:56.712917 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.712878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9f2x\" (UniqueName: \"kubernetes.io/projected/76418493-0e91-46b8-9bf4-130eadd3ecbb-kube-api-access-b9f2x\") pod \"migrator-6865c9967-8gpjn\" (UID: \"76418493-0e91-46b8-9bf4-130eadd3ecbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" Jul 24 20:15:56.721904 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.721868 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9f2x\" (UniqueName: \"kubernetes.io/projected/76418493-0e91-46b8-9bf4-130eadd3ecbb-kube-api-access-b9f2x\") pod \"migrator-6865c9967-8gpjn\" (UID: \"76418493-0e91-46b8-9bf4-130eadd3ecbb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" Jul 24 20:15:56.799524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.799477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" Jul 24 20:15:56.945432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.945389 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn"] Jul 24 20:15:56.948293 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:56.948262 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76418493_0e91_46b8_9bf4_130eadd3ecbb.slice/crio-391ce4970b8f9e20ef3849676030d00ca8497939336abcf0da85460233e40d39 WatchSource:0}: Error finding container 391ce4970b8f9e20ef3849676030d00ca8497939336abcf0da85460233e40d39: Status 404 returned error can't find the container with id 391ce4970b8f9e20ef3849676030d00ca8497939336abcf0da85460233e40d39 Jul 24 20:15:56.988127 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988067 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/1.log" Jul 24 20:15:56.988596 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/0.log" Jul 24 20:15:56.988596 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988532 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" exitCode=255 Jul 24 20:15:56.988708 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" event={"ID":"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678","Type":"ContainerDied","Data":"8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00"} Jul 24 20:15:56.988708 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988665 2574 scope.go:117] "RemoveContainer" containerID="c613801e876bd011dd01d9f0385173f387bdf2ec2b56eb1045ae6a8d7b21caaf" Jul 24 20:15:56.989208 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.988996 2574 scope.go:117] "RemoveContainer" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" Jul 24 20:15:56.989345 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:56.989210 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:15:56.990002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:56.989977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" event={"ID":"76418493-0e91-46b8-9bf4-130eadd3ecbb","Type":"ContainerStarted","Data":"391ce4970b8f9e20ef3849676030d00ca8497939336abcf0da85460233e40d39"} Jul 24 20:15:57.422219 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.422182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:57.422423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.422235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:15:57.422423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.422262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:15:57.422423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.422302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:15:57.422423 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422321 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:15:57.422423 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422407 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.422381699 +0000 UTC m=+66.219974784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:15:57.422674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422454 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:57.422674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422485 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.422422466 +0000 UTC m=+66.220015550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:15:57.422674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422454 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 20:15:57.422674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422509 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.42249806 +0000 UTC m=+66.220091147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:15:57.422674 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.422566 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls podName:8409bf8a-5b16-4375-b751-5faadc49d8f0 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.422556773 +0000 UTC m=+66.220149861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls") pod "cluster-samples-operator-6748489656-xh82f" (UID: "8409bf8a-5b16-4375-b751-5faadc49d8f0") : secret "samples-operator-tls" not found Jul 24 20:15:57.441331 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.439457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rrc85"] Jul 24 20:15:57.459706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.459482 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rrc85"] Jul 24 20:15:57.459706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.459618 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.462454 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.462430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5d6mv\"" Jul 24 20:15:57.462873 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.462851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 20:15:57.463014 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.462880 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 20:15:57.523898 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.523807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:15:57.523898 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.523866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca531a14-badf-4b57-aad3-776891918500-data-volume\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.524203 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.524153 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:15:57.524253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.524220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca531a14-badf-4b57-aad3-776891918500-crio-socket\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.524253 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.524238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.524213396 +0000 UTC m=+66.321806499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:15:57.524340 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.524322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.524389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.524348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.524524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.524503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjww\" (UniqueName: \"kubernetes.io/projected/ca531a14-badf-4b57-aad3-776891918500-kube-api-access-xtjww\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625106 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjww\" (UniqueName: \"kubernetes.io/projected/ca531a14-badf-4b57-aad3-776891918500-kube-api-access-xtjww\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625314 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca531a14-badf-4b57-aad3-776891918500-data-volume\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625314 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca531a14-badf-4b57-aad3-776891918500-crio-socket\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625314 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625314 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625519 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.625398 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 20:15:57.625519 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.625456 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 20:15:57.625519 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.625472 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:58.125445429 +0000 UTC m=+58.923038515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : configmap "kube-rbac-proxy" not found Jul 24 20:15:57.625519 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625397 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca531a14-badf-4b57-aad3-776891918500-crio-socket\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.625519 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.625502 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:58.125488443 +0000 UTC m=+58.923081525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : secret "insights-runtime-extractor-tls" not found Jul 24 20:15:57.625721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.625549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca531a14-badf-4b57-aad3-776891918500-data-volume\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.634942 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.634899 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjww\" (UniqueName: \"kubernetes.io/projected/ca531a14-badf-4b57-aad3-776891918500-kube-api-access-xtjww\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:57.995903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.995858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/1.log" Jul 24 20:15:57.996389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:57.996293 2574 scope.go:117] "RemoveContainer" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" Jul 24 20:15:57.996561 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:57.996519 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:15:58.131187 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:58.131138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:58.131187 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:58.131189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:58.131449 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:58.131276 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 20:15:58.131449 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:58.131306 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 20:15:58.131449 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:58.131359 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:59.131342429 +0000 UTC m=+59.928935515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : secret "insights-runtime-extractor-tls" not found Jul 24 20:15:58.131449 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:58.131386 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:15:59.13137821 +0000 UTC m=+59.928971308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : configmap "kube-rbac-proxy" not found Jul 24 20:15:58.887474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:58.887431 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92phv" Jul 24 20:15:59.001145 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.001034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" event={"ID":"76418493-0e91-46b8-9bf4-130eadd3ecbb","Type":"ContainerStarted","Data":"0cabfe62c13f5ef9f74746c629f9268b17a25f900b9c76b17827b2039bc723df"} Jul 24 20:15:59.001145 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.001112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" event={"ID":"76418493-0e91-46b8-9bf4-130eadd3ecbb","Type":"ContainerStarted","Data":"c60808a81b84b9979bcf70e40e881d8f1ab70fe86f91eb78a792e0cb24d69d7a"} Jul 24 20:15:59.018280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.018213 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-8gpjn" podStartSLOduration=1.52331487 podStartE2EDuration="3.018191654s" totalImagesPullingTime="1.494876784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:15:59.017969933 +0000 UTC m=+59.815563040" watchObservedRunningTime="2026-07-24 20:15:59.018191654 +0000 UTC m=+59.815784761" Jul 24 20:15:59.141600 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.141557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:59.141600 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.141600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:15:59.141832 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:59.141680 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 20:15:59.141832 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:59.141700 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 20:15:59.141832 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:59.141745 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:01.141732164 +0000 UTC m=+61.939325246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : secret "insights-runtime-extractor-tls" not found Jul 24 20:15:59.141832 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:59.141757 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:01.141751753 +0000 UTC m=+61.939344835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : configmap "kube-rbac-proxy" not found Jul 24 20:15:59.310226 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.310189 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qwsxz"] Jul 24 20:15:59.312983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.312950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.315735 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.315708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 20:15:59.316030 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.316012 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 20:15:59.316447 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.316430 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 20:15:59.316567 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.316530 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4cq2m\"" Jul 24 20:15:59.316641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.316628 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 20:15:59.323136 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.323112 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qwsxz"] Jul 24 20:15:59.444433 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.444383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldqm2\" (UniqueName: \"kubernetes.io/projected/5eb78803-83b4-4085-aa8c-aae78dcf504b-kube-api-access-ldqm2\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.444656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.444459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-cabundle\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.444727 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.444660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-key\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.545580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.545537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-key\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.545790 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.545621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldqm2\" (UniqueName: \"kubernetes.io/projected/5eb78803-83b4-4085-aa8c-aae78dcf504b-kube-api-access-ldqm2\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.545790 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.545661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-cabundle\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.546445 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.546424 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-cabundle\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.548091 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.548059 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5eb78803-83b4-4085-aa8c-aae78dcf504b-signing-key\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.554361 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.554336 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldqm2\" (UniqueName: \"kubernetes.io/projected/5eb78803-83b4-4085-aa8c-aae78dcf504b-kube-api-access-ldqm2\") pod \"service-ca-658d7b7c78-qwsxz\" (UID: \"5eb78803-83b4-4085-aa8c-aae78dcf504b\") " pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.624201 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.624123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4cq2m\"" Jul 24 20:15:59.632113 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.632087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" Jul 24 20:15:59.645793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.645766 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmltz_22f6d2ca-c02d-4a07-8f79-72508fb85ca5/dns-node-resolver/0.log" Jul 24 20:15:59.769872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.769836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qwsxz"] Jul 24 20:15:59.774367 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.774338 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:59.774502 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.774404 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:15:59.774819 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:15:59.774800 2574 scope.go:117] "RemoveContainer" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" Jul 24 20:15:59.775039 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:15:59.775014 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:15:59.775337 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:15:59.775305 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb78803_83b4_4085_aa8c_aae78dcf504b.slice/crio-a41a9f8e1ba6da42ed71717f15697b50bb95acfd566ec98d8f7a19296164edc8 WatchSource:0}: Error finding container a41a9f8e1ba6da42ed71717f15697b50bb95acfd566ec98d8f7a19296164edc8: Status 404 returned error can't find the container with id a41a9f8e1ba6da42ed71717f15697b50bb95acfd566ec98d8f7a19296164edc8 Jul 24 20:16:00.006288 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:00.006177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" event={"ID":"5eb78803-83b4-4085-aa8c-aae78dcf504b","Type":"ContainerStarted","Data":"8aafbabdfae015e37ea526e93bbc67d2e6f64100d67daebcbd6b920ac377d9d8"} Jul 24 20:16:00.006288 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:00.006240 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" event={"ID":"5eb78803-83b4-4085-aa8c-aae78dcf504b","Type":"ContainerStarted","Data":"a41a9f8e1ba6da42ed71717f15697b50bb95acfd566ec98d8f7a19296164edc8"} Jul 24 20:16:00.035682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:00.035617 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-qwsxz" podStartSLOduration=1.035594682 podStartE2EDuration="1.035594682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:00.035323752 +0000 UTC m=+60.832916885" watchObservedRunningTime="2026-07-24 20:16:00.035594682 +0000 UTC m=+60.833187789" Jul 24 20:16:00.446573 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:00.446543 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9x9zw_94029bd9-7225-4de9-b477-a42bd882ca7b/node-ca/0.log" Jul 24 20:16:01.046193 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.046150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzchh_1723737e-ee40-45e4-8557-0c2eec6c5586/serve-healthcheck-canary/0.log" Jul 24 20:16:01.162539 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.162498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:01.162539 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.162546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:01.162831 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:01.162646 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 20:16:01.162831 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:01.162646 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 20:16:01.162831 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:01.162722 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.162701014 +0000 UTC m=+65.960294100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : configmap "kube-rbac-proxy" not found Jul 24 20:16:01.162831 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:01.162751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:05.162735976 +0000 UTC m=+65.960329059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : secret "insights-runtime-extractor-tls" not found Jul 24 20:16:01.248140 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.248101 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8gpjn_76418493-0e91-46b8-9bf4-130eadd3ecbb/migrator/0.log" Jul 24 20:16:01.446464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.446372 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8gpjn_76418493-0e91-46b8-9bf4-130eadd3ecbb/graceful-termination/0.log" Jul 24 20:16:01.647835 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:01.647801 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx_afe6cb3c-3c98-4782-b4ea-82ffb4de97cf/kube-storage-version-migrator-operator/0.log" Jul 24 20:16:04.400300 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.400259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:16:04.403137 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.403113 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 20:16:04.411301 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:04.411273 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 20:16:04.411452 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:04.411357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs podName:409918d3-b2da-4844-a3f8-c341604c02f6 nodeName:}" failed. No retries permitted until 2026-07-24 20:17:08.411332875 +0000 UTC m=+129.208925974 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs") pod "network-metrics-daemon-2x7rw" (UID: "409918d3-b2da-4844-a3f8-c341604c02f6") : secret "metrics-daemon-secret" not found Jul 24 20:16:04.501206 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.501158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:16:04.504212 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.504192 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 20:16:04.513920 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.513891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43a29076-4718-4bf1-af6c-dc8ce087247f-original-pull-secret\") pod \"global-pull-secret-syncer-k2lvf\" (UID: \"43a29076-4718-4bf1-af6c-dc8ce087247f\") " pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:16:04.532041 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.532000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k2lvf" Jul 24 20:16:04.603500 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.602930 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:16:04.614988 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.614920 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqrk\" (UniqueName: \"kubernetes.io/projected/c4e3e0ad-e090-469f-bb63-a7a116f3204f-kube-api-access-hhqrk\") pod \"network-check-target-28d2d\" (UID: \"c4e3e0ad-e090-469f-bb63-a7a116f3204f\") " pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:16:04.691647 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.691607 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k2lvf"] Jul 24 20:16:04.694356 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:04.694323 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a29076_4718_4bf1_af6c_dc8ce087247f.slice/crio-17f2948191d70e555075bbcd25c4be66380c772aee258f3c730abc5ae1dd547d WatchSource:0}: Error finding container 17f2948191d70e555075bbcd25c4be66380c772aee258f3c730abc5ae1dd547d: Status 404 returned error can't find the container with id 17f2948191d70e555075bbcd25c4be66380c772aee258f3c730abc5ae1dd547d Jul 24 20:16:04.841760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.841721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b8xdt\"" Jul 24 20:16:04.849983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:04.849951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:16:05.009126 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.009100 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28d2d"] Jul 24 20:16:05.011679 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:05.011651 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e3e0ad_e090_469f_bb63_a7a116f3204f.slice/crio-b54aba61c651d757f4363ffdd233bd4522a51cbe93f56040beee5354db72d50d WatchSource:0}: Error finding container b54aba61c651d757f4363ffdd233bd4522a51cbe93f56040beee5354db72d50d: Status 404 returned error can't find the container with id b54aba61c651d757f4363ffdd233bd4522a51cbe93f56040beee5354db72d50d Jul 24 20:16:05.023872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.023830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28d2d" event={"ID":"c4e3e0ad-e090-469f-bb63-a7a116f3204f","Type":"ContainerStarted","Data":"b54aba61c651d757f4363ffdd233bd4522a51cbe93f56040beee5354db72d50d"} Jul 24 20:16:05.024984 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.024952 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2lvf" event={"ID":"43a29076-4718-4bf1-af6c-dc8ce087247f","Type":"ContainerStarted","Data":"17f2948191d70e555075bbcd25c4be66380c772aee258f3c730abc5ae1dd547d"} Jul 24 20:16:05.209775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.209677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:05.209775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.209720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:05.209981 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.209798 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 20:16:05.209981 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.209865 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 20:16:05.209981 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.209871 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:13.209855238 +0000 UTC m=+74.007448321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : configmap "kube-rbac-proxy" not found Jul 24 20:16:05.209981 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.209903 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls podName:ca531a14-badf-4b57-aad3-776891918500 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:13.209893012 +0000 UTC m=+74.007486100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rrc85" (UID: "ca531a14-badf-4b57-aad3-776891918500") : secret "insights-runtime-extractor-tls" not found Jul 24 20:16:05.513121 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.513083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.513130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.513165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.513220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.513231 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.513288 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.513295 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:16:21.513276455 +0000 UTC m=+82.310869544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : secret "router-metrics-certs-default" not found Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.513368 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls podName:97597482-f3d5-486c-a5ec-9f34ce9cd7e2 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:21.513349174 +0000 UTC m=+82.310942257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-zsxkq" (UID: "97597482-f3d5-486c-a5ec-9f34ce9cd7e2") : secret "cluster-monitoring-operator-tls" not found Jul 24 20:16:05.513569 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.513422 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle podName:fe0f6ad8-dcd1-4280-868a-bb246359eb2c nodeName:}" failed. No retries permitted until 2026-07-24 20:16:21.513414825 +0000 UTC m=+82.311007932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle") pod "router-default-7fffc66b69-rfwq8" (UID: "fe0f6ad8-dcd1-4280-868a-bb246359eb2c") : configmap references non-existent config key: service-ca.crt Jul 24 20:16:05.516673 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.516629 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8409bf8a-5b16-4375-b751-5faadc49d8f0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-xh82f\" (UID: \"8409bf8a-5b16-4375-b751-5faadc49d8f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:16:05.614089 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.614049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:16:05.614275 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.614232 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 20:16:05.614374 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:05.614322 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert podName:f0503f3e-709c-4ff4-a09c-268dca991206 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:21.614298453 +0000 UTC m=+82.411891587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dfsqw" (UID: "f0503f3e-709c-4ff4-a09c-268dca991206") : secret "networking-console-plugin-cert" not found Jul 24 20:16:05.814368 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.814276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cr45z\"" Jul 24 20:16:05.821393 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.821278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" Jul 24 20:16:05.917053 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.916992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:16:05.917053 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.917050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:16:05.920534 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.920427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0-metrics-tls\") pod \"dns-default-ttvpd\" (UID: \"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0\") " pod="openshift-dns/dns-default-ttvpd" Jul 24 20:16:05.920534 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:05.920479 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"image-registry-596b4c7f86-xdgzj\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:16:06.002334 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.002237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f"] Jul 24 20:16:06.031874 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.031822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28d2d" event={"ID":"c4e3e0ad-e090-469f-bb63-a7a116f3204f","Type":"ContainerStarted","Data":"d5558002d5faf9d41a750c0c4305569d04de8ba3d99c35aa432c6e64f9f0d2f6"} Jul 24 20:16:06.032059 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.031890 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:16:06.050884 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.050829 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-28d2d" podStartSLOduration=66.050809536 podStartE2EDuration="1m6.050809536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:06.050265556 +0000 UTC m=+66.847858662" watchObservedRunningTime="2026-07-24 20:16:06.050809536 +0000 UTC m=+66.848402674" Jul 24 20:16:06.137155 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.136918 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpp76\"" Jul 24 20:16:06.145284 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.145227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:16:06.160786 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.160751 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mgpkh\"" Jul 24 20:16:06.168541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.168467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ttvpd" Jul 24 20:16:06.339655 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.339560 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:16:06.343365 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:06.343299 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2154160c_0ec9_4b46_865a_0bcc882e00c1.slice/crio-4e6dea81c8c3efb75e7c879d050e52a5d99c211b202d92e4e7c40078d064f872 WatchSource:0}: Error finding container 4e6dea81c8c3efb75e7c879d050e52a5d99c211b202d92e4e7c40078d064f872: Status 404 returned error can't find the container with id 4e6dea81c8c3efb75e7c879d050e52a5d99c211b202d92e4e7c40078d064f872 Jul 24 20:16:06.373100 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:06.373050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ttvpd"] Jul 24 20:16:06.377442 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:06.377402 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8064ab_1f7b_4bd7_9a91_771eb14ea1f0.slice/crio-4128cb201d8fb34a288526513a5c5acb99265656caf2e8167cabdc62ac321db8 WatchSource:0}: Error finding container 4128cb201d8fb34a288526513a5c5acb99265656caf2e8167cabdc62ac321db8: Status 404 returned error can't find the container with id 4128cb201d8fb34a288526513a5c5acb99265656caf2e8167cabdc62ac321db8 Jul 24 20:16:07.041819 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.041715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" event={"ID":"8409bf8a-5b16-4375-b751-5faadc49d8f0","Type":"ContainerStarted","Data":"caffb09429f6a5bf8072389194b4214dd597deaa64d938ea5f32ddf03e2fd74f"} Jul 24 20:16:07.044883 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.044844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttvpd" event={"ID":"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0","Type":"ContainerStarted","Data":"4128cb201d8fb34a288526513a5c5acb99265656caf2e8167cabdc62ac321db8"} Jul 24 20:16:07.048861 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.048721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" event={"ID":"2154160c-0ec9-4b46-865a-0bcc882e00c1","Type":"ContainerStarted","Data":"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc"} Jul 24 20:16:07.048861 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.048779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" event={"ID":"2154160c-0ec9-4b46-865a-0bcc882e00c1","Type":"ContainerStarted","Data":"4e6dea81c8c3efb75e7c879d050e52a5d99c211b202d92e4e7c40078d064f872"} Jul 24 20:16:07.048861 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.048823 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:16:07.068807 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:07.068333 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" podStartSLOduration=67.068310991 podStartE2EDuration="1m7.068310991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:07.067820494 +0000 UTC m=+67.865413601" watchObservedRunningTime="2026-07-24 20:16:07.068310991 +0000 UTC m=+67.865904096" Jul 24 20:16:10.066419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.065783 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k2lvf" event={"ID":"43a29076-4718-4bf1-af6c-dc8ce087247f","Type":"ContainerStarted","Data":"522a2fc711302413e37c7eeebe9a5e5bcc3d42dce04e916b20253e01893845c4"} Jul 24 20:16:10.071832 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.071791 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" event={"ID":"8409bf8a-5b16-4375-b751-5faadc49d8f0","Type":"ContainerStarted","Data":"747e0a9a68240b933df8a6f65eb3e4d030f0ae9c6bc6cd9bfbe703f1dca44350"} Jul 24 20:16:10.071995 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.071866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" event={"ID":"8409bf8a-5b16-4375-b751-5faadc49d8f0","Type":"ContainerStarted","Data":"519d6f700cd061347defc44ff1283a8b6252b2982073032a0543edc51b4ee023"} Jul 24 20:16:10.075100 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.075029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttvpd" event={"ID":"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0","Type":"ContainerStarted","Data":"bac6f6ecd48a01db9eb0dbc7ce19aee4b8b16503c41645bf0dc97742597f8d47"} Jul 24 20:16:10.093650 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.093577 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k2lvf" podStartSLOduration=64.910383202 podStartE2EDuration="1m10.093552947s" totalImagesPullingTime="5.183169745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:10.09199379 +0000 UTC m=+70.889586899" watchObservedRunningTime="2026-07-24 20:16:10.093552947 +0000 UTC m=+70.891146053" Jul 24 20:16:10.112406 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:10.112287 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-xh82f" podStartSLOduration=17.33919117 podStartE2EDuration="21.112261465s" totalImagesPullingTime="3.773070295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:10.110852864 +0000 UTC m=+70.908446002" watchObservedRunningTime="2026-07-24 20:16:10.112261465 +0000 UTC m=+70.909854573" Jul 24 20:16:11.084782 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:11.084739 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ttvpd" event={"ID":"1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0","Type":"ContainerStarted","Data":"2a02daf1a50fdd8868c1bd2d14ad7553afe6715d630f0872decf00cc3b06a032"} Jul 24 20:16:11.085419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:11.085026 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ttvpd" Jul 24 20:16:11.117959 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:11.117884 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ttvpd" podStartSLOduration=33.627675395 podStartE2EDuration="37.11786515s" totalImagesPullingTime="3.490189755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:11.116201358 +0000 UTC m=+71.913794462" watchObservedRunningTime="2026-07-24 20:16:11.11786515 +0000 UTC m=+71.915458255" Jul 24 20:16:12.708304 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:12.708275 2574 scope.go:117] "RemoveContainer" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" Jul 24 20:16:13.094315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.094281 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:16:13.094727 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.094709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/1.log" Jul 24 20:16:13.094798 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.094748 2574 generic.go:356] "Generic (PLEG): container finished" podID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" containerID="f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475" exitCode=255 Jul 24 20:16:13.094851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.094829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" event={"ID":"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678","Type":"ContainerDied","Data":"f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475"} Jul 24 20:16:13.094917 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.094904 2574 scope.go:117] "RemoveContainer" containerID="8164bea55b46764f2a9b61147169d9eab499ad528450dce2e20f373412fdcf00" Jul 24 20:16:13.095358 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.095336 2574 scope.go:117] "RemoveContainer" containerID="f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475" Jul 24 20:16:13.095546 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:13.095525 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:16:13.294217 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.294168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:13.294217 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.294220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:13.294668 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.294648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca531a14-badf-4b57-aad3-776891918500-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:13.296625 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.296598 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca531a14-badf-4b57-aad3-776891918500-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrc85\" (UID: \"ca531a14-badf-4b57-aad3-776891918500\") " pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:13.374410 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.374313 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5d6mv\"" Jul 24 20:16:13.382508 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.382474 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rrc85" Jul 24 20:16:13.517924 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:13.517898 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rrc85"] Jul 24 20:16:13.520507 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:13.520484 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca531a14_badf_4b57_aad3_776891918500.slice/crio-84023ec0868bbd7e2cf79a082fdce5b9e94793fadd6b8044a080ffd0dfaf9b45 WatchSource:0}: Error finding container 84023ec0868bbd7e2cf79a082fdce5b9e94793fadd6b8044a080ffd0dfaf9b45: Status 404 returned error can't find the container with id 84023ec0868bbd7e2cf79a082fdce5b9e94793fadd6b8044a080ffd0dfaf9b45 Jul 24 20:16:14.102613 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:14.102508 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrc85" event={"ID":"ca531a14-badf-4b57-aad3-776891918500","Type":"ContainerStarted","Data":"84023ec0868bbd7e2cf79a082fdce5b9e94793fadd6b8044a080ffd0dfaf9b45"} Jul 24 20:16:14.105456 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:14.105340 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:16:19.132140 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:19.132094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrc85" event={"ID":"ca531a14-badf-4b57-aad3-776891918500","Type":"ContainerStarted","Data":"ecb6010813c6ca41374777982c5efeb83caa9e3fe879972ebc4981004520f5bc"} Jul 24 20:16:19.773906 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:19.773870 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:16:19.774148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:19.773944 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:16:19.774406 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:19.774385 2574 scope.go:117] "RemoveContainer" containerID="f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475" Jul 24 20:16:19.774632 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:19.774598 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:16:21.091009 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.090977 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ttvpd" Jul 24 20:16:21.577786 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.577746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:21.577786 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.577800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:16:21.578094 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.577828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:21.578576 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.578524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-service-ca-bundle\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:21.580591 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.580561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97597482-f3d5-486c-a5ec-9f34ce9cd7e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-zsxkq\" (UID: \"97597482-f3d5-486c-a5ec-9f34ce9cd7e2\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:16:21.580952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.580918 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe0f6ad8-dcd1-4280-868a-bb246359eb2c-metrics-certs\") pod \"router-default-7fffc66b69-rfwq8\" (UID: \"fe0f6ad8-dcd1-4280-868a-bb246359eb2c\") " pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:21.678517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.678481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:16:21.679140 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.679114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dgdwk\"" Jul 24 20:16:21.681023 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.680998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0503f3e-709c-4ff4-a09c-268dca991206-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dfsqw\" (UID: \"f0503f3e-709c-4ff4-a09c-268dca991206\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:16:21.686360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.686329 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" Jul 24 20:16:21.704106 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.704063 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nn2sp\"" Jul 24 20:16:21.711641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.711603 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:21.804603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.804567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tbdhh\"" Jul 24 20:16:21.811239 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.811197 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" Jul 24 20:16:21.937271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.937182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq"] Jul 24 20:16:21.940976 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:21.940881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97597482_f3d5_486c_a5ec_9f34ce9cd7e2.slice/crio-d49b7e3127e14c2a999fedde9dc4ab7158aaa014e0813203ce1cfa2d92e494bc WatchSource:0}: Error finding container d49b7e3127e14c2a999fedde9dc4ab7158aaa014e0813203ce1cfa2d92e494bc: Status 404 returned error can't find the container with id d49b7e3127e14c2a999fedde9dc4ab7158aaa014e0813203ce1cfa2d92e494bc Jul 24 20:16:21.966380 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.966348 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fffc66b69-rfwq8"] Jul 24 20:16:21.968256 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:21.968223 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0f6ad8_dcd1_4280_868a_bb246359eb2c.slice/crio-c2302a9c4f2718beca0075dfaaadf3e724bccafc6abc44d89d6c8ee752469ad0 WatchSource:0}: Error finding container c2302a9c4f2718beca0075dfaaadf3e724bccafc6abc44d89d6c8ee752469ad0: Status 404 returned error can't find the container with id c2302a9c4f2718beca0075dfaaadf3e724bccafc6abc44d89d6c8ee752469ad0 Jul 24 20:16:21.991860 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:21.991825 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw"] Jul 24 20:16:21.997331 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:21.997293 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0503f3e_709c_4ff4_a09c_268dca991206.slice/crio-6e4a0dfcbf7a7c8ccc3397213c9ee52886575cad1a37d1e6cc75549f69579178 WatchSource:0}: Error finding container 6e4a0dfcbf7a7c8ccc3397213c9ee52886575cad1a37d1e6cc75549f69579178: Status 404 returned error can't find the container with id 6e4a0dfcbf7a7c8ccc3397213c9ee52886575cad1a37d1e6cc75549f69579178 Jul 24 20:16:22.145034 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.144937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" event={"ID":"f0503f3e-709c-4ff4-a09c-268dca991206","Type":"ContainerStarted","Data":"6e4a0dfcbf7a7c8ccc3397213c9ee52886575cad1a37d1e6cc75549f69579178"} Jul 24 20:16:22.146508 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.146481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" event={"ID":"fe0f6ad8-dcd1-4280-868a-bb246359eb2c","Type":"ContainerStarted","Data":"c5acf0865a6b61e0c6711d3430f37c9dbe184e17bb549016cbc102ac7d72a9bf"} Jul 24 20:16:22.146656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.146523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" event={"ID":"fe0f6ad8-dcd1-4280-868a-bb246359eb2c","Type":"ContainerStarted","Data":"c2302a9c4f2718beca0075dfaaadf3e724bccafc6abc44d89d6c8ee752469ad0"} Jul 24 20:16:22.147786 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.147756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" event={"ID":"97597482-f3d5-486c-a5ec-9f34ce9cd7e2","Type":"ContainerStarted","Data":"d49b7e3127e14c2a999fedde9dc4ab7158aaa014e0813203ce1cfa2d92e494bc"} Jul 24 20:16:22.149659 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.149628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrc85" event={"ID":"ca531a14-badf-4b57-aad3-776891918500","Type":"ContainerStarted","Data":"4001cc489599e45bbe36e8f526acd32671a2ca35eb58d3f3f51d54b2cc05f007"} Jul 24 20:16:22.165141 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.165067 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" podStartSLOduration=33.165044548 podStartE2EDuration="33.165044548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:22.164632306 +0000 UTC m=+82.962225411" watchObservedRunningTime="2026-07-24 20:16:22.165044548 +0000 UTC m=+82.962637654" Jul 24 20:16:22.712238 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.712151 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:22.715757 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:22.715723 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:23.155903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:23.155838 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:23.157754 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:23.157533 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fffc66b69-rfwq8" Jul 24 20:16:26.150198 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.150155 2574 patch_prober.go:28] interesting pod/image-registry-596b4c7f86-xdgzj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 20:16:26.150612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.150222 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 20:16:26.763569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.763524 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7"] Jul 24 20:16:26.779723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.779630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7"] Jul 24 20:16:26.779723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.779706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:26.782652 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.782620 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 20:16:26.782958 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.782938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gpdf6\"" Jul 24 20:16:26.836064 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.836018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-svfq7\" (UID: \"704c999a-2ef4-4c7f-9038-f3ef609955b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:26.936731 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:26.936683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-svfq7\" (UID: \"704c999a-2ef4-4c7f-9038-f3ef609955b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:26.936998 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:26.936829 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 20:16:26.936998 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:26.936897 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates podName:704c999a-2ef4-4c7f-9038-f3ef609955b9 nodeName:}" failed. No retries permitted until 2026-07-24 20:16:27.436879303 +0000 UTC m=+88.234472400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-svfq7" (UID: "704c999a-2ef4-4c7f-9038-f3ef609955b9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 20:16:27.172116 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.172022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" event={"ID":"f0503f3e-709c-4ff4-a09c-268dca991206","Type":"ContainerStarted","Data":"8d6e0af36d9cb23fef129357169834de65b5d58d037cfa6b5937da5ba653348e"} Jul 24 20:16:27.173533 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.173505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" event={"ID":"97597482-f3d5-486c-a5ec-9f34ce9cd7e2","Type":"ContainerStarted","Data":"f550e3ba787be2c10ea39d2f9f2f21108aced664e46be234fcd0600fb736965c"} Jul 24 20:16:27.175671 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.175646 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrc85" event={"ID":"ca531a14-badf-4b57-aad3-776891918500","Type":"ContainerStarted","Data":"a821fe8d724421d898027f1ebc1265fca95848884de606a4342e65e9bff6d539"} Jul 24 20:16:27.190415 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.190360 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dfsqw" podStartSLOduration=33.984699482 podStartE2EDuration="38.190337776s" totalImagesPullingTime="4.205638294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:27.189404667 +0000 UTC m=+87.986997787" watchObservedRunningTime="2026-07-24 20:16:27.190337776 +0000 UTC m=+87.987930881" Jul 24 20:16:27.207236 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.207166 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-zsxkq" podStartSLOduration=33.945250491 podStartE2EDuration="38.207139313s" totalImagesPullingTime="4.261888822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:27.205503447 +0000 UTC m=+88.003096553" watchObservedRunningTime="2026-07-24 20:16:27.207139313 +0000 UTC m=+88.004732421" Jul 24 20:16:27.227029 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.226951 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rrc85" podStartSLOduration=17.381296629 podStartE2EDuration="30.226931992s" totalImagesPullingTime="12.845635363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 20:15:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:27.226168102 +0000 UTC m=+88.023761229" watchObservedRunningTime="2026-07-24 20:16:27.226931992 +0000 UTC m=+88.024525096" Jul 24 20:16:27.442509 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.442399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-svfq7\" (UID: \"704c999a-2ef4-4c7f-9038-f3ef609955b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:27.445086 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.445038 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/704c999a-2ef4-4c7f-9038-f3ef609955b9-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-svfq7\" (UID: \"704c999a-2ef4-4c7f-9038-f3ef609955b9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:27.690349 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.690307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:27.854891 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:27.854662 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7"] Jul 24 20:16:27.857706 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:27.857677 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704c999a_2ef4_4c7f_9038_f3ef609955b9.slice/crio-659302ad13e8407649b89d329e4f814345fa75f00a49244e7bec8cf737b625e7 WatchSource:0}: Error finding container 659302ad13e8407649b89d329e4f814345fa75f00a49244e7bec8cf737b625e7: Status 404 returned error can't find the container with id 659302ad13e8407649b89d329e4f814345fa75f00a49244e7bec8cf737b625e7 Jul 24 20:16:28.181295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:28.181256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" event={"ID":"704c999a-2ef4-4c7f-9038-f3ef609955b9","Type":"ContainerStarted","Data":"659302ad13e8407649b89d329e4f814345fa75f00a49244e7bec8cf737b625e7"} Jul 24 20:16:29.061105 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:29.061048 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:16:29.186304 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:29.186211 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" event={"ID":"704c999a-2ef4-4c7f-9038-f3ef609955b9","Type":"ContainerStarted","Data":"c544efd9125d90154d84bcc47b04d84b38c54d7b6ab36bfd9a15114baa0e6e3c"} Jul 24 20:16:29.186689 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:29.186365 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:29.191624 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:29.191593 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" Jul 24 20:16:29.205027 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:29.204949 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-svfq7" podStartSLOduration=2.159002968 podStartE2EDuration="3.204932213s" totalImagesPullingTime="1.045929245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:29.20429188 +0000 UTC m=+90.001884992" watchObservedRunningTime="2026-07-24 20:16:29.204932213 +0000 UTC m=+90.002525333" Jul 24 20:16:32.708807 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:32.708775 2574 scope.go:117] "RemoveContainer" containerID="f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475" Jul 24 20:16:32.709226 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:16:32.708944 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-r7vws_openshift-console-operator(d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podUID="d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678" Jul 24 20:16:37.051128 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:37.051095 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-28d2d" Jul 24 20:16:39.329132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.329094 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2hgpn"] Jul 24 20:16:39.337291 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.337253 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.342030 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.341997 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 20:16:39.342514 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.342488 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p7mnv\"" Jul 24 20:16:39.342797 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.342782 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 20:16:39.343367 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.343344 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 20:16:39.348396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.348373 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 20:16:39.444903 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.444867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-tls\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.444913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-wtmp\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.444940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x97\" (UniqueName: \"kubernetes.io/projected/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-kube-api-access-76x97\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-metrics-client-ca\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-sys\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-root\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-textfile\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.445446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.445195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546152 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-tls\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546152 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-wtmp\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76x97\" (UniqueName: \"kubernetes.io/projected/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-kube-api-access-76x97\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-metrics-client-ca\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-sys\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-root\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546353 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-root\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546357 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-wtmp\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-textfile\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546777 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546357 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-sys\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546777 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546777 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.546905 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.546781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-textfile\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.547349 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.547322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.547531 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.547384 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-metrics-client-ca\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.548904 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.548879 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.549086 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.549057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-node-exporter-tls\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.558971 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.558933 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x97\" (UniqueName: \"kubernetes.io/projected/c9359ecb-b1ba-46e9-992f-b99b80bc76fb-kube-api-access-76x97\") pod \"node-exporter-2hgpn\" (UID: \"c9359ecb-b1ba-46e9-992f-b99b80bc76fb\") " pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.650110 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:39.650004 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hgpn" Jul 24 20:16:39.681037 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:39.680998 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9359ecb_b1ba_46e9_992f_b99b80bc76fb.slice/crio-0b5b95fb3ad3d2423392501f70e96aef7370c71f702263c7d83900433e2048bc WatchSource:0}: Error finding container 0b5b95fb3ad3d2423392501f70e96aef7370c71f702263c7d83900433e2048bc: Status 404 returned error can't find the container with id 0b5b95fb3ad3d2423392501f70e96aef7370c71f702263c7d83900433e2048bc Jul 24 20:16:40.235874 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:40.235828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hgpn" event={"ID":"c9359ecb-b1ba-46e9-992f-b99b80bc76fb","Type":"ContainerStarted","Data":"0b5b95fb3ad3d2423392501f70e96aef7370c71f702263c7d83900433e2048bc"} Jul 24 20:16:41.241983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:41.241959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hgpn" event={"ID":"c9359ecb-b1ba-46e9-992f-b99b80bc76fb","Type":"ContainerStarted","Data":"9f93e1eed52888b245587ae17d4908d251b89f24faf44fa49bfcb0ac9f5c7f86"} Jul 24 20:16:42.247906 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:42.247868 2574 generic.go:356] "Generic (PLEG): container finished" podID="c9359ecb-b1ba-46e9-992f-b99b80bc76fb" containerID="9f93e1eed52888b245587ae17d4908d251b89f24faf44fa49bfcb0ac9f5c7f86" exitCode=0 Jul 24 20:16:42.248431 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:42.247922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hgpn" event={"ID":"c9359ecb-b1ba-46e9-992f-b99b80bc76fb","Type":"ContainerDied","Data":"9f93e1eed52888b245587ae17d4908d251b89f24faf44fa49bfcb0ac9f5c7f86"} Jul 24 20:16:43.258464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:43.258420 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hgpn" event={"ID":"c9359ecb-b1ba-46e9-992f-b99b80bc76fb","Type":"ContainerStarted","Data":"046c4800050a14d626ab141cd3024ce2a047662b9761f3c3079eef836d20d7d7"} Jul 24 20:16:43.259099 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:43.258527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hgpn" event={"ID":"c9359ecb-b1ba-46e9-992f-b99b80bc76fb","Type":"ContainerStarted","Data":"da9d8f0bf79dd1b281a420757114cc7edeea538cd300e94201a7fbb81824d85a"} Jul 24 20:16:43.280057 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:43.279990 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2hgpn" podStartSLOduration=2.855696756 podStartE2EDuration="4.279972548s" totalImagesPullingTime="1.322735858s" totalInitContainerRuntime="101.539934ms" isStatefulPod=true podCreationTimestamp="2026-07-24 20:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:43.279233772 +0000 UTC m=+104.076826898" watchObservedRunningTime="2026-07-24 20:16:43.279972548 +0000 UTC m=+104.077565652" Jul 24 20:16:44.708754 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:44.708716 2574 scope.go:117] "RemoveContainer" containerID="f45ca78fcf1fb7bbbf54a0c52231ae2a4a5134f39356a39891691f873b55a475" Jul 24 20:16:45.269858 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:45.269824 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:16:45.270039 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:45.269927 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" event={"ID":"d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678","Type":"ContainerStarted","Data":"eabbbfa5e6ce4bf2b153ff0a660675da116e55dab7ca76bfd7963e2161d4a4c7"} Jul 24 20:16:45.270224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:45.270205 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:16:45.275398 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:45.275364 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" Jul 24 20:16:45.291891 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:45.291836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-r7vws" podStartSLOduration=51.277815492 podStartE2EDuration="56.291818546s" totalImagesPullingTime="5.014003054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:16:45.291005599 +0000 UTC m=+106.088598729" watchObservedRunningTime="2026-07-24 20:16:45.291818546 +0000 UTC m=+106.089411650" Jul 24 20:16:47.032460 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:47.032420 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:16:56.119124 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.119060 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:16:56.140093 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.140033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:16:56.140268 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.140190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.143432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.143401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 20:16:56.143616 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.143439 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 20:16:56.143616 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.143463 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 20:16:56.144458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.144318 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 20:16:56.144458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.144442 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-26qmn\"" Jul 24 20:16:56.144458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.144455 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 20:16:56.144744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.144449 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 20:16:56.144744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.144536 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 20:16:56.196173 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.196356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9dmc\" (UniqueName: \"kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.196356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.196356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.196468 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.196468 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.196450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.297677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.297882 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.297882 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.297882 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.297882 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9dmc\" (UniqueName: \"kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.298061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.297896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.298586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.298562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.298586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.298574 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.299068 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.298708 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.300395 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.300364 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.300395 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.300372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.308539 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.308510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9dmc\" (UniqueName: \"kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc\") pod \"console-6659ff5978-7v6v8\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.451034 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.450929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:16:56.603515 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:56.603480 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:16:56.607412 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:16:56.607376 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819f3430_d912_4e12_b53f_b454be4d0cc5.slice/crio-18f8da4d4401a2b7636765bf64451865b701fea050ce87b9b714886cf4b78e31 WatchSource:0}: Error finding container 18f8da4d4401a2b7636765bf64451865b701fea050ce87b9b714886cf4b78e31: Status 404 returned error can't find the container with id 18f8da4d4401a2b7636765bf64451865b701fea050ce87b9b714886cf4b78e31 Jul 24 20:16:57.322699 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:16:57.322651 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6659ff5978-7v6v8" event={"ID":"819f3430-d912-4e12-b53f-b454be4d0cc5","Type":"ContainerStarted","Data":"18f8da4d4401a2b7636765bf64451865b701fea050ce87b9b714886cf4b78e31"} Jul 24 20:17:00.336599 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:00.336560 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6659ff5978-7v6v8" event={"ID":"819f3430-d912-4e12-b53f-b454be4d0cc5","Type":"ContainerStarted","Data":"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790"} Jul 24 20:17:00.357956 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:00.357896 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6659ff5978-7v6v8" podStartSLOduration=1.078845992 podStartE2EDuration="4.357879465s" totalImagesPullingTime="3.279033473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:17:00.355635329 +0000 UTC m=+121.153228433" watchObservedRunningTime="2026-07-24 20:17:00.357879465 +0000 UTC m=+121.155472569" Jul 24 20:17:06.451289 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:06.451237 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:06.451859 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:06.451323 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:06.456419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:06.456389 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:07.370449 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.370418 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:07.703407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.703319 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:17:07.705941 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.705920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.720160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.720125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:17:07.720693 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.720673 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 20:17:07.802228 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802228 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4mz\" (UniqueName: \"kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.802471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.802447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4mz\" (UniqueName: \"kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.903682 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.903675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.904302 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.904277 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.904424 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.904312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.904424 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.904385 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.904507 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.904495 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.906159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.906137 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.906159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.906152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:07.913588 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:07.913565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4mz\" (UniqueName: \"kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz\") pod \"console-6496648f45-mrhwr\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:08.019665 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.019613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:08.159700 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.159662 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:17:08.163186 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:17:08.163146 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e78da1_afe2_46a7_aa9c_988e034ddbf7.slice/crio-ed72ee2742f0f92060956614a2c877bf2a91c1df6e45d2b610c417aa48667700 WatchSource:0}: Error finding container ed72ee2742f0f92060956614a2c877bf2a91c1df6e45d2b610c417aa48667700: Status 404 returned error can't find the container with id ed72ee2742f0f92060956614a2c877bf2a91c1df6e45d2b610c417aa48667700 Jul 24 20:17:08.372272 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.372166 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496648f45-mrhwr" event={"ID":"04e78da1-afe2-46a7-aa9c-988e034ddbf7","Type":"ContainerStarted","Data":"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993"} Jul 24 20:17:08.372272 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.372232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496648f45-mrhwr" event={"ID":"04e78da1-afe2-46a7-aa9c-988e034ddbf7","Type":"ContainerStarted","Data":"ed72ee2742f0f92060956614a2c877bf2a91c1df6e45d2b610c417aa48667700"} Jul 24 20:17:08.395686 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.395629 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6496648f45-mrhwr" podStartSLOduration=1.3956093969999999 podStartE2EDuration="1.395609397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:17:08.394730728 +0000 UTC m=+129.192323836" watchObservedRunningTime="2026-07-24 20:17:08.395609397 +0000 UTC m=+129.193202501" Jul 24 20:17:08.509006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.508723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:17:08.511216 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.511181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/409918d3-b2da-4844-a3f8-c341604c02f6-metrics-certs\") pod \"network-metrics-daemon-2x7rw\" (UID: \"409918d3-b2da-4844-a3f8-c341604c02f6\") " pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:17:08.726587 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.726490 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2sm2r\"" Jul 24 20:17:08.733242 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.733210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x7rw" Jul 24 20:17:08.871497 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:08.871458 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x7rw"] Jul 24 20:17:08.875033 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:17:08.875001 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409918d3_b2da_4844_a3f8_c341604c02f6.slice/crio-abf0fd287d3188a3386139e33f5d4a157aae9c3055d5bb72d88a7914c3035d6d WatchSource:0}: Error finding container abf0fd287d3188a3386139e33f5d4a157aae9c3055d5bb72d88a7914c3035d6d: Status 404 returned error can't find the container with id abf0fd287d3188a3386139e33f5d4a157aae9c3055d5bb72d88a7914c3035d6d Jul 24 20:17:09.377174 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:09.377128 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x7rw" event={"ID":"409918d3-b2da-4844-a3f8-c341604c02f6","Type":"ContainerStarted","Data":"abf0fd287d3188a3386139e33f5d4a157aae9c3055d5bb72d88a7914c3035d6d"} Jul 24 20:17:10.387088 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:10.387032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x7rw" event={"ID":"409918d3-b2da-4844-a3f8-c341604c02f6","Type":"ContainerStarted","Data":"67ffaeb483c9078720b1732bc344899852c37a6cdc873c300380bcdf56ec5e4e"} Jul 24 20:17:10.387488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:10.387108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x7rw" event={"ID":"409918d3-b2da-4844-a3f8-c341604c02f6","Type":"ContainerStarted","Data":"9feaa66ed1b30465551bf7bcb1fb129395076eb8ca39bb01b2dd14795e703989"} Jul 24 20:17:10.404250 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:10.404189 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2x7rw" podStartSLOduration=130.309773252 podStartE2EDuration="2m11.404171494s" totalImagesPullingTime="1.094398242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:17:10.402036811 +0000 UTC m=+131.199629953" watchObservedRunningTime="2026-07-24 20:17:10.404171494 +0000 UTC m=+131.201764598" Jul 24 20:17:12.052953 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.052906 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerName="registry" containerID="cri-o://c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc" gracePeriod=30 Jul 24 20:17:12.304887 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.304812 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:17:12.396293 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.396254 2574 generic.go:356] "Generic (PLEG): container finished" podID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerID="c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc" exitCode=0 Jul 24 20:17:12.396491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.396308 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" Jul 24 20:17:12.396491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.396343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" event={"ID":"2154160c-0ec9-4b46-865a-0bcc882e00c1","Type":"ContainerDied","Data":"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc"} Jul 24 20:17:12.396491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.396403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-596b4c7f86-xdgzj" event={"ID":"2154160c-0ec9-4b46-865a-0bcc882e00c1","Type":"ContainerDied","Data":"4e6dea81c8c3efb75e7c879d050e52a5d99c211b202d92e4e7c40078d064f872"} Jul 24 20:17:12.396491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.396431 2574 scope.go:117] "RemoveContainer" containerID="c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc" Jul 24 20:17:12.404995 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.404966 2574 scope.go:117] "RemoveContainer" containerID="c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc" Jul 24 20:17:12.405388 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:17:12.405363 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc\": container with ID starting with c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc not found: ID does not exist" containerID="c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc" Jul 24 20:17:12.405444 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.405400 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc"} err="failed to get container status \"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc\": rpc error: code = NotFound desc = could not find container \"c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc\": container with ID starting with c8d322118e92bd3a1f841ce4f7098786dc772a429c180cdeb408133ca54314bc not found: ID does not exist" Jul 24 20:17:12.445692 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445658 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445714 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445754 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445788 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445804 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445826 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.445864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445859 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbncz\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.446432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.445891 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration\") pod \"2154160c-0ec9-4b46-865a-0bcc882e00c1\" (UID: \"2154160c-0ec9-4b46-865a-0bcc882e00c1\") " Jul 24 20:17:12.446432 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.446282 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:17:12.446799 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.446758 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:17:12.448680 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.448638 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:17:12.448806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.448690 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:17:12.448806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.448766 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:17:12.448950 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.448919 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz" (OuterVolumeSpecName: "kube-api-access-bbncz") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "kube-api-access-bbncz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:17:12.449018 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.448998 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:17:12.454983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.454945 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2154160c-0ec9-4b46-865a-0bcc882e00c1" (UID: "2154160c-0ec9-4b46-865a-0bcc882e00c1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:17:12.547316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547254 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-bound-sa-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547306 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-certificates\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547317 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbncz\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-kube-api-access-bbncz\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547327 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-image-registry-private-configuration\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547338 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2154160c-0ec9-4b46-865a-0bcc882e00c1-registry-tls\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547638 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547346 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2154160c-0ec9-4b46-865a-0bcc882e00c1-trusted-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547638 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547356 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2154160c-0ec9-4b46-865a-0bcc882e00c1-ca-trust-extracted\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.547638 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.547366 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2154160c-0ec9-4b46-865a-0bcc882e00c1-installation-pull-secrets\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:12.719720 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.719680 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:17:12.725629 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:12.725598 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-596b4c7f86-xdgzj"] Jul 24 20:17:13.713932 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:13.713893 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" path="/var/lib/kubelet/pods/2154160c-0ec9-4b46-865a-0bcc882e00c1/volumes" Jul 24 20:17:17.419147 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:17.419107 2574 generic.go:356] "Generic (PLEG): container finished" podID="fa746c21-3c68-4052-92e3-cf9a82ed9aea" containerID="9ad0c6621a671d2727d11058ebbffa848f3ffb38bd0298c151766263e2f63272" exitCode=0 Jul 24 20:17:17.419569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:17.419173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" event={"ID":"fa746c21-3c68-4052-92e3-cf9a82ed9aea","Type":"ContainerDied","Data":"9ad0c6621a671d2727d11058ebbffa848f3ffb38bd0298c151766263e2f63272"} Jul 24 20:17:17.419569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:17.419527 2574 scope.go:117] "RemoveContainer" containerID="9ad0c6621a671d2727d11058ebbffa848f3ffb38bd0298c151766263e2f63272" Jul 24 20:17:18.020343 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.020296 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:18.020569 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.020367 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:18.025326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.025295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:18.424940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.424836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-hkvd7" event={"ID":"fa746c21-3c68-4052-92e3-cf9a82ed9aea","Type":"ContainerStarted","Data":"f5b9cc5031f2aba0bb15d84dee0fb72cd427500195b406461b3be447e292629e"} Jul 24 20:17:18.429058 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.429031 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:17:18.490181 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:18.490145 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:17:21.438214 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:21.438175 2574 generic.go:356] "Generic (PLEG): container finished" podID="afe6cb3c-3c98-4782-b4ea-82ffb4de97cf" containerID="5e5b566b1f862c3f8a56c260e8674e57d0dcf8a97da8680cbf189be57fd70490" exitCode=0 Jul 24 20:17:21.438657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:21.438239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" event={"ID":"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf","Type":"ContainerDied","Data":"5e5b566b1f862c3f8a56c260e8674e57d0dcf8a97da8680cbf189be57fd70490"} Jul 24 20:17:21.438657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:21.438571 2574 scope.go:117] "RemoveContainer" containerID="5e5b566b1f862c3f8a56c260e8674e57d0dcf8a97da8680cbf189be57fd70490" Jul 24 20:17:22.444736 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:22.444693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx" event={"ID":"afe6cb3c-3c98-4782-b4ea-82ffb4de97cf","Type":"ContainerStarted","Data":"5db77002375f63dc0cdf02762572ae46770677b356e2738bd697116b20f90404"} Jul 24 20:17:26.462793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:26.462699 2574 generic.go:356] "Generic (PLEG): container finished" podID="69d3981a-71a9-4c3f-86ab-69c993f65fce" containerID="35d75cf9ad7db459960cbee556892f939ab230d5de3e222819fc4272fcc4a79a" exitCode=0 Jul 24 20:17:26.462793 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:26.462773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" event={"ID":"69d3981a-71a9-4c3f-86ab-69c993f65fce","Type":"ContainerDied","Data":"35d75cf9ad7db459960cbee556892f939ab230d5de3e222819fc4272fcc4a79a"} Jul 24 20:17:26.463253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:26.463187 2574 scope.go:117] "RemoveContainer" containerID="35d75cf9ad7db459960cbee556892f939ab230d5de3e222819fc4272fcc4a79a" Jul 24 20:17:27.468678 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:27.468638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ldwlf" event={"ID":"69d3981a-71a9-4c3f-86ab-69c993f65fce","Type":"ContainerStarted","Data":"936e04d27ccd071234983cef8a24516eb51bc15fc0b0b36b9ac6085b418b0dfe"} Jul 24 20:17:43.516126 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.516044 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6659ff5978-7v6v8" podUID="819f3430-d912-4e12-b53f-b454be4d0cc5" containerName="console" containerID="cri-o://20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790" gracePeriod=15 Jul 24 20:17:43.766043 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.766012 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:43.822002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.821893 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.821937 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9dmc\" (UniqueName: \"kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.821970 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.821988 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.822006 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822417 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.822035 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config\") pod \"819f3430-d912-4e12-b53f-b454be4d0cc5\" (UID: \"819f3430-d912-4e12-b53f-b454be4d0cc5\") " Jul 24 20:17:43.822495 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.822464 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:17:43.822556 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.822479 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config" (OuterVolumeSpecName: "console-config") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:17:43.822556 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.822478 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca" (OuterVolumeSpecName: "service-ca") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:17:43.824497 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.824461 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:17:43.824497 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.824461 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc" (OuterVolumeSpecName: "kube-api-access-r9dmc") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "kube-api-access-r9dmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:17:43.824656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.824493 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "819f3430-d912-4e12-b53f-b454be4d0cc5" (UID: "819f3430-d912-4e12-b53f-b454be4d0cc5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:17:43.923046 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923001 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:43.923046 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923030 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9dmc\" (UniqueName: \"kubernetes.io/projected/819f3430-d912-4e12-b53f-b454be4d0cc5-kube-api-access-r9dmc\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:43.923046 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923040 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:43.923046 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923053 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-oauth-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:43.923046 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923061 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/819f3430-d912-4e12-b53f-b454be4d0cc5-console-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:43.923382 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:43.923094 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/819f3430-d912-4e12-b53f-b454be4d0cc5-console-oauth-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:17:44.552421 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.552383 2574 generic.go:356] "Generic (PLEG): container finished" podID="819f3430-d912-4e12-b53f-b454be4d0cc5" containerID="20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790" exitCode=0 Jul 24 20:17:44.552872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.552449 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6659ff5978-7v6v8" Jul 24 20:17:44.552872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.552451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6659ff5978-7v6v8" event={"ID":"819f3430-d912-4e12-b53f-b454be4d0cc5","Type":"ContainerDied","Data":"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790"} Jul 24 20:17:44.552872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.552598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6659ff5978-7v6v8" event={"ID":"819f3430-d912-4e12-b53f-b454be4d0cc5","Type":"ContainerDied","Data":"18f8da4d4401a2b7636765bf64451865b701fea050ce87b9b714886cf4b78e31"} Jul 24 20:17:44.552872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.552623 2574 scope.go:117] "RemoveContainer" containerID="20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790" Jul 24 20:17:44.561703 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.561675 2574 scope.go:117] "RemoveContainer" containerID="20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790" Jul 24 20:17:44.562059 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:17:44.562033 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790\": container with ID starting with 20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790 not found: ID does not exist" containerID="20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790" Jul 24 20:17:44.562140 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.562079 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790"} err="failed to get container status \"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790\": rpc error: code = NotFound desc = could not find container \"20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790\": container with ID starting with 20ce82c134ee9f32e4421cfae18e1f41f636366746617d655428cd4d7eaf5790 not found: ID does not exist" Jul 24 20:17:44.574144 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.574109 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:17:44.575725 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:44.575697 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6659ff5978-7v6v8"] Jul 24 20:17:45.712706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:17:45.712665 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819f3430-d912-4e12-b53f-b454be4d0cc5" path="/var/lib/kubelet/pods/819f3430-d912-4e12-b53f-b454be4d0cc5/volumes" Jul 24 20:18:03.692957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.692918 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b6cb7765d-ml848"] Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693272 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819f3430-d912-4e12-b53f-b454be4d0cc5" containerName="console" Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693285 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="819f3430-d912-4e12-b53f-b454be4d0cc5" containerName="console" Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693300 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerName="registry" Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693305 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerName="registry" Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693374 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2154160c-0ec9-4b46-865a-0bcc882e00c1" containerName="registry" Jul 24 20:18:03.693407 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.693382 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="819f3430-d912-4e12-b53f-b454be4d0cc5" containerName="console" Jul 24 20:18:03.696528 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.696505 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.699233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.699203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q57wr\"" Jul 24 20:18:03.699233 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.699227 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 20:18:03.700025 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.700003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 20:18:03.700289 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.700271 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 20:18:03.701584 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.701563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 20:18:03.701770 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.701753 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 20:18:03.706121 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.706091 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 20:18:03.714878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.714837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b6cb7765d-ml848"] Jul 24 20:18:03.782128 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782128 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-federate-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5bs\" (UniqueName: \"kubernetes.io/projected/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-kube-api-access-ds5bs\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-serving-certs-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-metrics-client-ca\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.782512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.782362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883017 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.882975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883017 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-federate-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5bs\" (UniqueName: \"kubernetes.io/projected/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-kube-api-access-ds5bs\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-serving-certs-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-metrics-client-ca\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.883532 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.884001 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883972 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-serving-certs-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.884001 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.883988 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-metrics-client-ca\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.884206 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.884182 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.885734 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.885705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.885832 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.885810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-federate-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.885968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.885952 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-secret-telemeter-client\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.886004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.885960 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-telemeter-client-tls\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:03.895498 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:03.895468 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5bs\" (UniqueName: \"kubernetes.io/projected/40cfb334-36ac-4ce6-97c0-9a016b3dbff2-kube-api-access-ds5bs\") pod \"telemeter-client-6b6cb7765d-ml848\" (UID: \"40cfb334-36ac-4ce6-97c0-9a016b3dbff2\") " pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:04.008171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:04.008135 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" Jul 24 20:18:04.158851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:04.158820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b6cb7765d-ml848"] Jul 24 20:18:04.161122 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:18:04.161092 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cfb334_36ac_4ce6_97c0_9a016b3dbff2.slice/crio-a1a5352d5696dad58c48df9573ae643c4e131b32008807e6290c1e77189c95bf WatchSource:0}: Error finding container a1a5352d5696dad58c48df9573ae643c4e131b32008807e6290c1e77189c95bf: Status 404 returned error can't find the container with id a1a5352d5696dad58c48df9573ae643c4e131b32008807e6290c1e77189c95bf Jul 24 20:18:04.630135 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:04.630098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" event={"ID":"40cfb334-36ac-4ce6-97c0-9a016b3dbff2","Type":"ContainerStarted","Data":"a1a5352d5696dad58c48df9573ae643c4e131b32008807e6290c1e77189c95bf"} Jul 24 20:18:06.639773 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:06.639729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" event={"ID":"40cfb334-36ac-4ce6-97c0-9a016b3dbff2","Type":"ContainerStarted","Data":"d88257a9547acef93d7e79249c119d2f8ceb2e87dde33203f29632db0ac75e58"} Jul 24 20:18:07.646183 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:07.646141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" event={"ID":"40cfb334-36ac-4ce6-97c0-9a016b3dbff2","Type":"ContainerStarted","Data":"e29e4ff51f6e77a42eeec362839e3d42713b6044117182cb9c65b05eecda3bf1"} Jul 24 20:18:07.646577 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:07.646237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" event={"ID":"40cfb334-36ac-4ce6-97c0-9a016b3dbff2","Type":"ContainerStarted","Data":"3a905236bc80ff33552af9337f02189c05431236a68bcddaa684c81153b37983"} Jul 24 20:18:07.672235 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:07.672179 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b6cb7765d-ml848" podStartSLOduration=1.81734864 podStartE2EDuration="4.672159007s" totalImagesPullingTime="2.854810367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:18:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:18:07.669445927 +0000 UTC m=+188.467039032" watchObservedRunningTime="2026-07-24 20:18:07.672159007 +0000 UTC m=+188.469752140" Jul 24 20:18:08.322429 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.322394 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:18:08.325126 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.325089 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.336213 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.336178 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:18:08.430589 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430589 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430831 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430831 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6z68\" (UniqueName: \"kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430831 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430831 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.430831 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.430796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.531866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.531742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6z68\" (UniqueName: \"kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.532547 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.532514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.532698 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.532527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.532698 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.532527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.532877 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.532851 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.534325 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.534305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.534413 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.534401 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.540710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.540684 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6z68\" (UniqueName: \"kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68\") pod \"console-5b69b5574f-74cw5\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.638315 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.638216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:08.775285 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:08.775257 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:18:08.777697 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:18:08.777666 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f4a311_1430_45db_b717_c54390381056.slice/crio-cde5099205c02273e84ed187e5e3257f5f499ae6ba7f0c200e6a95104606a90e WatchSource:0}: Error finding container cde5099205c02273e84ed187e5e3257f5f499ae6ba7f0c200e6a95104606a90e: Status 404 returned error can't find the container with id cde5099205c02273e84ed187e5e3257f5f499ae6ba7f0c200e6a95104606a90e Jul 24 20:18:09.658310 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:09.658271 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b69b5574f-74cw5" event={"ID":"13f4a311-1430-45db-b717-c54390381056","Type":"ContainerStarted","Data":"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46"} Jul 24 20:18:09.658499 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:09.658325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b69b5574f-74cw5" event={"ID":"13f4a311-1430-45db-b717-c54390381056","Type":"ContainerStarted","Data":"cde5099205c02273e84ed187e5e3257f5f499ae6ba7f0c200e6a95104606a90e"} Jul 24 20:18:09.676549 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:09.676491 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b69b5574f-74cw5" podStartSLOduration=1.676470987 podStartE2EDuration="1.676470987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:18:09.674997745 +0000 UTC m=+190.472590884" watchObservedRunningTime="2026-07-24 20:18:09.676470987 +0000 UTC m=+190.474064091" Jul 24 20:18:18.638900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:18.638858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:18.638900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:18.638916 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:18.643735 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:18.643709 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:18.705490 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:18.705459 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:18:18.750886 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:18.750842 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:18:43.774479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:43.774416 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6496648f45-mrhwr" podUID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" containerName="console" containerID="cri-o://2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993" gracePeriod=15 Jul 24 20:18:44.015772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.015743 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:18:44.027875 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027777 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.027875 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027836 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027880 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027924 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027955 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz4mz\" (UniqueName: \"kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.027976 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.028017 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle\") pod \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\" (UID: \"04e78da1-afe2-46a7-aa9c-988e034ddbf7\") " Jul 24 20:18:44.028390 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.028305 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:18:44.028446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.028414 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config" (OuterVolumeSpecName: "console-config") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:18:44.028782 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.028739 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca" (OuterVolumeSpecName: "service-ca") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:18:44.028920 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.028892 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:18:44.030177 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.030150 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:18:44.030456 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.030426 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:18:44.030542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.030467 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz" (OuterVolumeSpecName: "kube-api-access-wz4mz") pod "04e78da1-afe2-46a7-aa9c-988e034ddbf7" (UID: "04e78da1-afe2-46a7-aa9c-988e034ddbf7"). InnerVolumeSpecName "kube-api-access-wz4mz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:18:44.128721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128677 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-oauth-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.128721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128714 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz4mz\" (UniqueName: \"kubernetes.io/projected/04e78da1-afe2-46a7-aa9c-988e034ddbf7-kube-api-access-wz4mz\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.128721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128724 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.128721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128733 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-trusted-ca-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.129120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128742 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.129120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128761 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-oauth-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.129120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.128770 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04e78da1-afe2-46a7-aa9c-988e034ddbf7-console-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:18:44.805647 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.805602 2574 generic.go:356] "Generic (PLEG): container finished" podID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" containerID="2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993" exitCode=0 Jul 24 20:18:44.806044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.805662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496648f45-mrhwr" event={"ID":"04e78da1-afe2-46a7-aa9c-988e034ddbf7","Type":"ContainerDied","Data":"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993"} Jul 24 20:18:44.806044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.805686 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496648f45-mrhwr" Jul 24 20:18:44.806044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.805715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496648f45-mrhwr" event={"ID":"04e78da1-afe2-46a7-aa9c-988e034ddbf7","Type":"ContainerDied","Data":"ed72ee2742f0f92060956614a2c877bf2a91c1df6e45d2b610c417aa48667700"} Jul 24 20:18:44.806044 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.805742 2574 scope.go:117] "RemoveContainer" containerID="2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993" Jul 24 20:18:44.814778 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.814757 2574 scope.go:117] "RemoveContainer" containerID="2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993" Jul 24 20:18:44.815132 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:18:44.815107 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993\": container with ID starting with 2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993 not found: ID does not exist" containerID="2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993" Jul 24 20:18:44.815213 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.815139 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993"} err="failed to get container status \"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993\": rpc error: code = NotFound desc = could not find container \"2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993\": container with ID starting with 2223bd3a11abb5758329b88b9bcef9905cff75fb08c2490c9fed78176bc5b993 not found: ID does not exist" Jul 24 20:18:44.827500 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.827467 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:18:44.831089 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:44.831045 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6496648f45-mrhwr"] Jul 24 20:18:45.713148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:18:45.713104 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" path="/var/lib/kubelet/pods/04e78da1-afe2-46a7-aa9c-988e034ddbf7/volumes" Jul 24 20:19:14.326968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.326931 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:19:14.327558 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.327538 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" containerName="console" Jul 24 20:19:14.327636 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.327562 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" containerName="console" Jul 24 20:19:14.327734 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.327683 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e78da1-afe2-46a7-aa9c-988e034ddbf7" containerName="console" Jul 24 20:19:14.332625 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.332593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.342959 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.342927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:19:14.501434 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501434 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47cs\" (UniqueName: \"kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501679 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501679 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501679 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501679 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.501679 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.501630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47cs\" (UniqueName: \"kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602535 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602535 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.602535 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.603012 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.603169 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.602984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.603253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.603225 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.603530 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.603508 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.604745 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.604714 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.604944 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.604923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.609878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.609850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47cs\" (UniqueName: \"kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs\") pod \"console-64f7bf74cc-bgvdv\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.644728 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.644683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:14.788356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.788169 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:19:14.791304 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:19:14.791266 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41b5e6e_a6ee_49fe_bdc3_8cd98c1559a0.slice/crio-925d6ab42a351dc71d13acdcad0618d9e49d2dda9e203cd2e58f4aac2a85f359 WatchSource:0}: Error finding container 925d6ab42a351dc71d13acdcad0618d9e49d2dda9e203cd2e58f4aac2a85f359: Status 404 returned error can't find the container with id 925d6ab42a351dc71d13acdcad0618d9e49d2dda9e203cd2e58f4aac2a85f359 Jul 24 20:19:14.925515 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.925425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f7bf74cc-bgvdv" event={"ID":"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0","Type":"ContainerStarted","Data":"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c"} Jul 24 20:19:14.925515 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.925482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f7bf74cc-bgvdv" event={"ID":"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0","Type":"ContainerStarted","Data":"925d6ab42a351dc71d13acdcad0618d9e49d2dda9e203cd2e58f4aac2a85f359"} Jul 24 20:19:14.941792 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:14.941742 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64f7bf74cc-bgvdv" podStartSLOduration=0.94172049 podStartE2EDuration="941.72049ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:19:14.941595927 +0000 UTC m=+255.739189032" watchObservedRunningTime="2026-07-24 20:19:14.94172049 +0000 UTC m=+255.739313595" Jul 24 20:19:24.644905 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:24.644806 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:24.644905 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:24.644874 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:24.649677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:24.649656 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:24.970918 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:24.970832 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:19:25.016908 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:25.016872 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:19:50.038687 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.038638 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b69b5574f-74cw5" podUID="13f4a311-1430-45db-b717-c54390381056" containerName="console" containerID="cri-o://ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46" gracePeriod=15 Jul 24 20:19:50.287149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.287112 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:19:50.406356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406236 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406332 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406440 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406485 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406524 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406568 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406802 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406620 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6z68\" (UniqueName: \"kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68\") pod \"13f4a311-1430-45db-b717-c54390381056\" (UID: \"13f4a311-1430-45db-b717-c54390381056\") " Jul 24 20:19:50.406856 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406813 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca" (OuterVolumeSpecName: "service-ca") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:19:50.406856 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406829 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:19:50.406953 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.406900 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:19:50.407137 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.407117 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.407212 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.407142 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-oauth-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.407212 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.407156 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-trusted-ca-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.407212 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.407140 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config" (OuterVolumeSpecName: "console-config") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:19:50.408658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.408625 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:19:50.408658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.408644 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:19:50.408806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.408753 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68" (OuterVolumeSpecName: "kube-api-access-h6z68") pod "13f4a311-1430-45db-b717-c54390381056" (UID: "13f4a311-1430-45db-b717-c54390381056"). InnerVolumeSpecName "kube-api-access-h6z68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:19:50.507523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.507488 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-oauth-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.507523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.507521 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13f4a311-1430-45db-b717-c54390381056-console-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.507523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.507530 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13f4a311-1430-45db-b717-c54390381056-console-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:50.507752 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:50.507540 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6z68\" (UniqueName: \"kubernetes.io/projected/13f4a311-1430-45db-b717-c54390381056-kube-api-access-h6z68\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:19:51.068201 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.068163 2574 generic.go:356] "Generic (PLEG): container finished" podID="13f4a311-1430-45db-b717-c54390381056" containerID="ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46" exitCode=0 Jul 24 20:19:51.068697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.068213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b69b5574f-74cw5" event={"ID":"13f4a311-1430-45db-b717-c54390381056","Type":"ContainerDied","Data":"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46"} Jul 24 20:19:51.068697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.068233 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b69b5574f-74cw5" Jul 24 20:19:51.068697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.068257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b69b5574f-74cw5" event={"ID":"13f4a311-1430-45db-b717-c54390381056","Type":"ContainerDied","Data":"cde5099205c02273e84ed187e5e3257f5f499ae6ba7f0c200e6a95104606a90e"} Jul 24 20:19:51.068697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.068277 2574 scope.go:117] "RemoveContainer" containerID="ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46" Jul 24 20:19:51.079053 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.079022 2574 scope.go:117] "RemoveContainer" containerID="ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46" Jul 24 20:19:51.079444 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:19:51.079421 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46\": container with ID starting with ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46 not found: ID does not exist" containerID="ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46" Jul 24 20:19:51.079507 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.079459 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46"} err="failed to get container status \"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46\": rpc error: code = NotFound desc = could not find container \"ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46\": container with ID starting with ceae7f7a12fd97c00ad8c487f65029dbc37a4e2b8f805081384b6bd1243e9f46 not found: ID does not exist" Jul 24 20:19:51.090661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.090629 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:19:51.094231 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.094203 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b69b5574f-74cw5"] Jul 24 20:19:51.713545 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:51.713510 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13f4a311-1430-45db-b717-c54390381056" path="/var/lib/kubelet/pods/13f4a311-1430-45db-b717-c54390381056/volumes" Jul 24 20:19:59.628402 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:59.628372 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:19:59.635489 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:59.635460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:19:59.638614 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:19:59.638586 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 20:20:01.756887 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.756853 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf"] Jul 24 20:20:01.759192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.757176 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f4a311-1430-45db-b717-c54390381056" containerName="console" Jul 24 20:20:01.759192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.757187 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f4a311-1430-45db-b717-c54390381056" containerName="console" Jul 24 20:20:01.759192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.757235 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="13f4a311-1430-45db-b717-c54390381056" containerName="console" Jul 24 20:20:01.760221 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.760203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:01.762869 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.762844 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 20:20:01.763036 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.762843 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 20:20:01.763687 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.763668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vzcbh\"" Jul 24 20:20:01.769354 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.769323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf"] Jul 24 20:20:01.911038 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.910984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:01.911038 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.911035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7vp\" (UniqueName: \"kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:01.911292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:01.911156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.011852 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.011771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.011852 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.011827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7vp\" (UniqueName: \"kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.012033 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.011892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.012115 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.012066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.012221 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.012206 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.027414 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.027377 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7vp\" (UniqueName: \"kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.070382 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.070340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:02.213656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.213598 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf"] Jul 24 20:20:02.216436 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:02.216405 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4194ba31_d914_4476_86e4_9b6e113d434b.slice/crio-4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764 WatchSource:0}: Error finding container 4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764: Status 404 returned error can't find the container with id 4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764 Jul 24 20:20:02.218661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:02.218642 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 20:20:03.120914 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:03.120879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" event={"ID":"4194ba31-d914-4476-86e4-9b6e113d434b","Type":"ContainerStarted","Data":"4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764"} Jul 24 20:20:09.149025 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:09.148929 2574 generic.go:356] "Generic (PLEG): container finished" podID="4194ba31-d914-4476-86e4-9b6e113d434b" containerID="1fbb57cf05ad716137f61d260f990c54658174f0d24ed5f310076300d0f54949" exitCode=0 Jul 24 20:20:09.149510 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:09.149020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" event={"ID":"4194ba31-d914-4476-86e4-9b6e113d434b","Type":"ContainerDied","Data":"1fbb57cf05ad716137f61d260f990c54658174f0d24ed5f310076300d0f54949"} Jul 24 20:20:12.164055 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:12.164017 2574 generic.go:356] "Generic (PLEG): container finished" podID="4194ba31-d914-4476-86e4-9b6e113d434b" containerID="15c196c0920c109090720f9895a5a0232033e2b583a7bee400832fb43db62b7a" exitCode=0 Jul 24 20:20:12.164485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:12.164117 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" event={"ID":"4194ba31-d914-4476-86e4-9b6e113d434b","Type":"ContainerDied","Data":"15c196c0920c109090720f9895a5a0232033e2b583a7bee400832fb43db62b7a"} Jul 24 20:20:20.201018 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:20.200981 2574 generic.go:356] "Generic (PLEG): container finished" podID="4194ba31-d914-4476-86e4-9b6e113d434b" containerID="35109e0bddae442911952a332a3ef8471e8565bc0d148eb946e556970f55b84e" exitCode=0 Jul 24 20:20:20.201463 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:20.201096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" event={"ID":"4194ba31-d914-4476-86e4-9b6e113d434b","Type":"ContainerDied","Data":"35109e0bddae442911952a332a3ef8471e8565bc0d148eb946e556970f55b84e"} Jul 24 20:20:21.377671 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.377632 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:21.482282 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.482178 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util\") pod \"4194ba31-d914-4476-86e4-9b6e113d434b\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " Jul 24 20:20:21.482282 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.482278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg7vp\" (UniqueName: \"kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp\") pod \"4194ba31-d914-4476-86e4-9b6e113d434b\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " Jul 24 20:20:21.482469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.482309 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle\") pod \"4194ba31-d914-4476-86e4-9b6e113d434b\" (UID: \"4194ba31-d914-4476-86e4-9b6e113d434b\") " Jul 24 20:20:21.482994 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.482958 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle" (OuterVolumeSpecName: "bundle") pod "4194ba31-d914-4476-86e4-9b6e113d434b" (UID: "4194ba31-d914-4476-86e4-9b6e113d434b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:21.484491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.484458 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp" (OuterVolumeSpecName: "kube-api-access-pg7vp") pod "4194ba31-d914-4476-86e4-9b6e113d434b" (UID: "4194ba31-d914-4476-86e4-9b6e113d434b"). InnerVolumeSpecName "kube-api-access-pg7vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:20:21.489319 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.489280 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util" (OuterVolumeSpecName: "util") pod "4194ba31-d914-4476-86e4-9b6e113d434b" (UID: "4194ba31-d914-4476-86e4-9b6e113d434b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:21.583484 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.583443 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:21.583484 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.583477 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg7vp\" (UniqueName: \"kubernetes.io/projected/4194ba31-d914-4476-86e4-9b6e113d434b-kube-api-access-pg7vp\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:21.583484 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:21.583488 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4194ba31-d914-4476-86e4-9b6e113d434b-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:22.212347 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:22.212316 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" Jul 24 20:20:22.212347 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:22.212328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540frnxf" event={"ID":"4194ba31-d914-4476-86e4-9b6e113d434b","Type":"ContainerDied","Data":"4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764"} Jul 24 20:20:22.212564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:22.212371 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4acf1a0a6e247516ca27e0e4e927c2923036c05ca8bed6f6e689e296b700e764" Jul 24 20:20:29.759035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.758998 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn"] Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759331 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="pull" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759342 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="pull" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759360 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="util" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759367 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="util" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759377 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="extract" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759382 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="extract" Jul 24 20:20:29.759524 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.759431 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4194ba31-d914-4476-86e4-9b6e113d434b" containerName="extract" Jul 24 20:20:29.762033 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.762016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.764880 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.764852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-z98p8\"" Jul 24 20:20:29.764991 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.764909 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:20:29.764991 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.764866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 20:20:29.775175 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.775139 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn"] Jul 24 20:20:29.858457 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.858390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lll\" (UniqueName: \"kubernetes.io/projected/9ff78632-c6fd-4dbe-854f-e1d61212c376-kube-api-access-69lll\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.858641 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.858493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff78632-c6fd-4dbe-854f-e1d61212c376-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.959702 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.959663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69lll\" (UniqueName: \"kubernetes.io/projected/9ff78632-c6fd-4dbe-854f-e1d61212c376-kube-api-access-69lll\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.959889 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.959733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff78632-c6fd-4dbe-854f-e1d61212c376-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.960118 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.960100 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff78632-c6fd-4dbe-854f-e1d61212c376-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:29.968416 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:29.968391 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lll\" (UniqueName: \"kubernetes.io/projected/9ff78632-c6fd-4dbe-854f-e1d61212c376-kube-api-access-69lll\") pod \"cert-manager-operator-controller-manager-55c444bf86-8lgdn\" (UID: \"9ff78632-c6fd-4dbe-854f-e1d61212c376\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:30.072412 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:30.072317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" Jul 24 20:20:30.216866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:30.216833 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn"] Jul 24 20:20:30.219733 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:30.219700 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff78632_c6fd_4dbe_854f_e1d61212c376.slice/crio-6c4e521c647de46c8a04290f84a7f5aa9e51182e09f00f73696fbb7b20270458 WatchSource:0}: Error finding container 6c4e521c647de46c8a04290f84a7f5aa9e51182e09f00f73696fbb7b20270458: Status 404 returned error can't find the container with id 6c4e521c647de46c8a04290f84a7f5aa9e51182e09f00f73696fbb7b20270458 Jul 24 20:20:30.247278 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:30.247237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" event={"ID":"9ff78632-c6fd-4dbe-854f-e1d61212c376","Type":"ContainerStarted","Data":"6c4e521c647de46c8a04290f84a7f5aa9e51182e09f00f73696fbb7b20270458"} Jul 24 20:20:32.264498 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:32.264451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" event={"ID":"9ff78632-c6fd-4dbe-854f-e1d61212c376","Type":"ContainerStarted","Data":"3884baf9ca18338251f70e190578da383c719d456fc8cae062b6dfa0fdf2d4d5"} Jul 24 20:20:32.291309 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:32.291245 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8lgdn" podStartSLOduration=1.392681929 podStartE2EDuration="3.29122729s" totalImagesPullingTime="1.898545361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:32.290447001 +0000 UTC m=+333.088040127" watchObservedRunningTime="2026-07-24 20:20:32.29122729 +0000 UTC m=+333.088820394" Jul 24 20:20:33.634532 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.634494 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b"] Jul 24 20:20:33.637038 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.637018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.639661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.639625 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 20:20:33.639809 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.639687 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 20:20:33.639809 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.639703 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vzcbh\"" Jul 24 20:20:33.646411 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.646383 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b"] Jul 24 20:20:33.694229 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.694182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76sf\" (UniqueName: \"kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.694229 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.694229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.694454 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.694247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.795105 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.795037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76sf\" (UniqueName: \"kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.795292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.795113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.795292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.795136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.795617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.795595 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.795617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.795608 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.803328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.803295 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76sf\" (UniqueName: \"kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:33.947803 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:33.947703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:34.095879 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:34.095671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b"] Jul 24 20:20:34.098950 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:34.098917 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1b15be_4306_431c_8043_0cc1f1082a0b.slice/crio-c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a WatchSource:0}: Error finding container c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a: Status 404 returned error can't find the container with id c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a Jul 24 20:20:34.275327 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:34.275292 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerID="f2371ef68ce52c77fd007e94eb6cae9f5cbf65f08ebb4455e961594cba97f983" exitCode=0 Jul 24 20:20:34.275512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:34.275383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" event={"ID":"8b1b15be-4306-431c-8043-0cc1f1082a0b","Type":"ContainerDied","Data":"f2371ef68ce52c77fd007e94eb6cae9f5cbf65f08ebb4455e961594cba97f983"} Jul 24 20:20:34.275512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:34.275438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" event={"ID":"8b1b15be-4306-431c-8043-0cc1f1082a0b","Type":"ContainerStarted","Data":"c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a"} Jul 24 20:20:37.292021 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:37.291986 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerID="28546b88a26a1244cfc27de977bfa454d2eb02260e30f622478f7a2818545be9" exitCode=0 Jul 24 20:20:37.292460 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:37.292058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" event={"ID":"8b1b15be-4306-431c-8043-0cc1f1082a0b","Type":"ContainerDied","Data":"28546b88a26a1244cfc27de977bfa454d2eb02260e30f622478f7a2818545be9"} Jul 24 20:20:38.298501 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:38.298466 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerID="a79a4071bd20ac4c9ebade2a69317ac4442e7a739fe0dbea07066035ffd4cf7f" exitCode=0 Jul 24 20:20:38.298934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:38.298551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" event={"ID":"8b1b15be-4306-431c-8043-0cc1f1082a0b","Type":"ContainerDied","Data":"a79a4071bd20ac4c9ebade2a69317ac4442e7a739fe0dbea07066035ffd4cf7f"} Jul 24 20:20:39.443295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.443255 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:39.548323 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.548278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle\") pod \"8b1b15be-4306-431c-8043-0cc1f1082a0b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " Jul 24 20:20:39.548505 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.548340 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util\") pod \"8b1b15be-4306-431c-8043-0cc1f1082a0b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " Jul 24 20:20:39.548505 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.548396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l76sf\" (UniqueName: \"kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf\") pod \"8b1b15be-4306-431c-8043-0cc1f1082a0b\" (UID: \"8b1b15be-4306-431c-8043-0cc1f1082a0b\") " Jul 24 20:20:39.548730 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.548708 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle" (OuterVolumeSpecName: "bundle") pod "8b1b15be-4306-431c-8043-0cc1f1082a0b" (UID: "8b1b15be-4306-431c-8043-0cc1f1082a0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:39.550617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.550587 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf" (OuterVolumeSpecName: "kube-api-access-l76sf") pod "8b1b15be-4306-431c-8043-0cc1f1082a0b" (UID: "8b1b15be-4306-431c-8043-0cc1f1082a0b"). InnerVolumeSpecName "kube-api-access-l76sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:20:39.552923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.552891 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util" (OuterVolumeSpecName: "util") pod "8b1b15be-4306-431c-8043-0cc1f1082a0b" (UID: "8b1b15be-4306-431c-8043-0cc1f1082a0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:39.649469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.649422 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l76sf\" (UniqueName: \"kubernetes.io/projected/8b1b15be-4306-431c-8043-0cc1f1082a0b-kube-api-access-l76sf\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:39.649469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.649457 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:39.649469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:39.649467 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b1b15be-4306-431c-8043-0cc1f1082a0b-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:40.309370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.309342 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" Jul 24 20:20:40.309560 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.309340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvrp5b" event={"ID":"8b1b15be-4306-431c-8043-0cc1f1082a0b","Type":"ContainerDied","Data":"c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a"} Jul 24 20:20:40.309560 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.309462 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4ae607260b4c47ecc42f6cb582a276900d19119762a71cb56a25d288d5a245a" Jul 24 20:20:40.325242 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325206 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pk6k9"] Jul 24 20:20:40.325545 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325533 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="pull" Jul 24 20:20:40.325586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325547 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="pull" Jul 24 20:20:40.325586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325557 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="util" Jul 24 20:20:40.325586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325562 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="util" Jul 24 20:20:40.325586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325571 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="extract" Jul 24 20:20:40.325586 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325577 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="extract" Jul 24 20:20:40.325739 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.325630 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1b15be-4306-431c-8043-0cc1f1082a0b" containerName="extract" Jul 24 20:20:40.327634 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.327612 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.330322 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.330292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 20:20:40.330322 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.330314 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rkqf5\"" Jul 24 20:20:40.330525 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.330292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 20:20:40.337965 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.337934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pk6k9"] Jul 24 20:20:40.458464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.458423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.458464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.458469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlfdd\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-kube-api-access-dlfdd\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.559177 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.559128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlfdd\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-kube-api-access-dlfdd\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.559356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.559231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.573543 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.573460 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.573695 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.573631 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlfdd\" (UniqueName: \"kubernetes.io/projected/8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb-kube-api-access-dlfdd\") pod \"cert-manager-webhook-6486ffd997-pk6k9\" (UID: \"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.647583 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.647537 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:40.792351 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:40.792310 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pk6k9"] Jul 24 20:20:40.795715 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:40.795678 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ad6ebce_7a2e_4439_aefa_2a9b35b2ddcb.slice/crio-14328e9937e9bfbef7793c116491c9d3ba12c85f38636d68606b816869eb5a26 WatchSource:0}: Error finding container 14328e9937e9bfbef7793c116491c9d3ba12c85f38636d68606b816869eb5a26: Status 404 returned error can't find the container with id 14328e9937e9bfbef7793c116491c9d3ba12c85f38636d68606b816869eb5a26 Jul 24 20:20:41.320787 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:41.320739 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" event={"ID":"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb","Type":"ContainerStarted","Data":"14328e9937e9bfbef7793c116491c9d3ba12c85f38636d68606b816869eb5a26"} Jul 24 20:20:46.212627 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.212582 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2"] Jul 24 20:20:46.238195 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.238148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2"] Jul 24 20:20:46.238398 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.238285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.241708 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.241681 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 20:20:46.242551 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.242533 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 20:20:46.242608 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.242555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fbw5d\"" Jul 24 20:20:46.311768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.311727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da280311-4b08-406b-8fb0-536f01fa93dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.311974 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.311802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5rx9\" (UniqueName: \"kubernetes.io/projected/da280311-4b08-406b-8fb0-536f01fa93dd-kube-api-access-q5rx9\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.346192 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.346150 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" event={"ID":"8ad6ebce-7a2e-4439-aefa-2a9b35b2ddcb","Type":"ContainerStarted","Data":"c43b47c5936880b4bc9a3ad8d97ead52234d41da45ec02a8a9edbcc0ab02f1da"} Jul 24 20:20:46.346376 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.346206 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:46.369654 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.369599 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" podStartSLOduration=1.857783924 podStartE2EDuration="6.369582227s" totalImagesPullingTime="4.511798303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:46.368386886 +0000 UTC m=+347.165979992" watchObservedRunningTime="2026-07-24 20:20:46.369582227 +0000 UTC m=+347.167175332" Jul 24 20:20:46.413258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.413215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da280311-4b08-406b-8fb0-536f01fa93dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.413464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.413299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5rx9\" (UniqueName: \"kubernetes.io/projected/da280311-4b08-406b-8fb0-536f01fa93dd-kube-api-access-q5rx9\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.413735 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.413711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da280311-4b08-406b-8fb0-536f01fa93dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.421986 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.421951 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5rx9\" (UniqueName: \"kubernetes.io/projected/da280311-4b08-406b-8fb0-536f01fa93dd-kube-api-access-q5rx9\") pod \"openshift-lws-operator-fd8ccff4c-rg8d2\" (UID: \"da280311-4b08-406b-8fb0-536f01fa93dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.547962 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.547923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" Jul 24 20:20:46.702483 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:46.702455 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2"] Jul 24 20:20:46.704610 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:46.704579 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda280311_4b08_406b_8fb0_536f01fa93dd.slice/crio-5554313eeb246659d48ca95af20a6eac81d1404047204f7616614604d3a4daf1 WatchSource:0}: Error finding container 5554313eeb246659d48ca95af20a6eac81d1404047204f7616614604d3a4daf1: Status 404 returned error can't find the container with id 5554313eeb246659d48ca95af20a6eac81d1404047204f7616614604d3a4daf1 Jul 24 20:20:47.352922 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:47.352882 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" event={"ID":"da280311-4b08-406b-8fb0-536f01fa93dd","Type":"ContainerStarted","Data":"5554313eeb246659d48ca95af20a6eac81d1404047204f7616614604d3a4daf1"} Jul 24 20:20:50.368153 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:50.368108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" event={"ID":"da280311-4b08-406b-8fb0-536f01fa93dd","Type":"ContainerStarted","Data":"4aa6aead73c468cc5a86025c0af8acc82706302be79ce2bd10580574eae1e245"} Jul 24 20:20:50.386501 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:50.386438 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rg8d2" podStartSLOduration=1.747487063 podStartE2EDuration="4.386421159s" totalImagesPullingTime="2.638934096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:20:50.385681985 +0000 UTC m=+351.183275090" watchObservedRunningTime="2026-07-24 20:20:50.386421159 +0000 UTC m=+351.184014264" Jul 24 20:20:52.356032 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:52.355941 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pk6k9" Jul 24 20:20:53.266512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.266470 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4"] Jul 24 20:20:53.269299 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.269270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.272025 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.271998 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 20:20:53.273144 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.273124 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 20:20:53.273250 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.273165 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vzcbh\"" Jul 24 20:20:53.277917 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.277884 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4"] Jul 24 20:20:53.377688 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.377637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.378243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.377762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq968\" (UniqueName: \"kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.378243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.377809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.479108 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.479046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.479292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.479179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq968\" (UniqueName: \"kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.479292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.479215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.479547 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.479522 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.479597 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.479548 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.487662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.487633 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq968\" (UniqueName: \"kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.580261 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.580169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:53.737194 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:53.737158 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4"] Jul 24 20:20:53.740539 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:20:53.740508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eeeba15_30a5_432a_a305_4af814e9c0cb.slice/crio-43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d WatchSource:0}: Error finding container 43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d: Status 404 returned error can't find the container with id 43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d Jul 24 20:20:54.387832 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:54.387799 2574 generic.go:356] "Generic (PLEG): container finished" podID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerID="90367e61b8c714c3ba2855de61cfe6fbfbd8b1c7ffb2a4c9c20ba751bab4ef77" exitCode=0 Jul 24 20:20:54.388286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:54.387889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" event={"ID":"2eeeba15-30a5-432a-a305-4af814e9c0cb","Type":"ContainerDied","Data":"90367e61b8c714c3ba2855de61cfe6fbfbd8b1c7ffb2a4c9c20ba751bab4ef77"} Jul 24 20:20:54.388286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:54.387944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" event={"ID":"2eeeba15-30a5-432a-a305-4af814e9c0cb","Type":"ContainerStarted","Data":"43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d"} Jul 24 20:20:55.394740 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:55.394703 2574 generic.go:356] "Generic (PLEG): container finished" podID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerID="c1bc36e123d5e0d750640619206b1934bfd35f652ae9f21db3c7bc3552c5ca37" exitCode=0 Jul 24 20:20:55.395282 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:55.394763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" event={"ID":"2eeeba15-30a5-432a-a305-4af814e9c0cb","Type":"ContainerDied","Data":"c1bc36e123d5e0d750640619206b1934bfd35f652ae9f21db3c7bc3552c5ca37"} Jul 24 20:20:56.401820 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:56.401778 2574 generic.go:356] "Generic (PLEG): container finished" podID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerID="81143128a12e468ed3e03198462d4b2754ca01fad4acd37c5a10bbb121fcc98a" exitCode=0 Jul 24 20:20:56.402329 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:56.401864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" event={"ID":"2eeeba15-30a5-432a-a305-4af814e9c0cb","Type":"ContainerDied","Data":"81143128a12e468ed3e03198462d4b2754ca01fad4acd37c5a10bbb121fcc98a"} Jul 24 20:20:57.547634 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.547602 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:57.713494 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.713400 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle\") pod \"2eeeba15-30a5-432a-a305-4af814e9c0cb\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " Jul 24 20:20:57.713494 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.713462 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util\") pod \"2eeeba15-30a5-432a-a305-4af814e9c0cb\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " Jul 24 20:20:57.713494 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.713491 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq968\" (UniqueName: \"kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968\") pod \"2eeeba15-30a5-432a-a305-4af814e9c0cb\" (UID: \"2eeeba15-30a5-432a-a305-4af814e9c0cb\") " Jul 24 20:20:57.714283 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.714250 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle" (OuterVolumeSpecName: "bundle") pod "2eeeba15-30a5-432a-a305-4af814e9c0cb" (UID: "2eeeba15-30a5-432a-a305-4af814e9c0cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:57.715708 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.715682 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968" (OuterVolumeSpecName: "kube-api-access-cq968") pod "2eeeba15-30a5-432a-a305-4af814e9c0cb" (UID: "2eeeba15-30a5-432a-a305-4af814e9c0cb"). InnerVolumeSpecName "kube-api-access-cq968". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:20:57.722040 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.721991 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util" (OuterVolumeSpecName: "util") pod "2eeeba15-30a5-432a-a305-4af814e9c0cb" (UID: "2eeeba15-30a5-432a-a305-4af814e9c0cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:20:57.814717 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.814668 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:57.814717 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.814709 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq968\" (UniqueName: \"kubernetes.io/projected/2eeeba15-30a5-432a-a305-4af814e9c0cb-kube-api-access-cq968\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:57.814717 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:57.814722 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2eeeba15-30a5-432a-a305-4af814e9c0cb-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:20:58.413658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:58.413625 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" Jul 24 20:20:58.413658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:58.413617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhz7s4" event={"ID":"2eeeba15-30a5-432a-a305-4af814e9c0cb","Type":"ContainerDied","Data":"43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d"} Jul 24 20:20:58.413878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:20:58.413680 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43e500f4169a85cf0680545763d8b11a0ceed307e39cc9afbb4c4908c086161d" Jul 24 20:21:09.443091 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443044 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w"] Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443384 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="extract" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443396 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="extract" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443408 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="pull" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443414 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="pull" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443422 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="util" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443427 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="util" Jul 24 20:21:09.443580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.443477 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eeeba15-30a5-432a-a305-4af814e9c0cb" containerName="extract" Jul 24 20:21:09.446208 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.446176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.450295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.450268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 20:21:09.450295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.450291 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 20:21:09.450525 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.450333 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 20:21:09.450525 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.450269 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z95z7\"" Jul 24 20:21:09.464507 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.464472 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w"] Jul 24 20:21:09.514318 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.514274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4dsb\" (UniqueName: \"kubernetes.io/projected/d79b7dc9-88c4-4afc-8058-ba5ee683de24-kube-api-access-j4dsb\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.514512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.514339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d79b7dc9-88c4-4afc-8058-ba5ee683de24-manager-config\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.514512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.514385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.514512 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.514403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-metrics-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.615231 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.615190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4dsb\" (UniqueName: \"kubernetes.io/projected/d79b7dc9-88c4-4afc-8058-ba5ee683de24-kube-api-access-j4dsb\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.615438 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.615259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d79b7dc9-88c4-4afc-8058-ba5ee683de24-manager-config\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.615438 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.615297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.615438 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.615321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-metrics-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.616089 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.616056 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d79b7dc9-88c4-4afc-8058-ba5ee683de24-manager-config\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.617956 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.617933 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.618045 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.617984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d79b7dc9-88c4-4afc-8058-ba5ee683de24-metrics-cert\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.623942 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.623912 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4dsb\" (UniqueName: \"kubernetes.io/projected/d79b7dc9-88c4-4afc-8058-ba5ee683de24-kube-api-access-j4dsb\") pod \"lws-controller-manager-779f8ddb8c-hrh4w\" (UID: \"d79b7dc9-88c4-4afc-8058-ba5ee683de24\") " pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.756527 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.756423 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:09.900417 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:09.900384 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w"] Jul 24 20:21:09.903004 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:21:09.902974 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79b7dc9_88c4_4afc_8058_ba5ee683de24.slice/crio-157820eeb4190ca65ab4811f1990399a8b570f8eb113823f072aabbc97014f27 WatchSource:0}: Error finding container 157820eeb4190ca65ab4811f1990399a8b570f8eb113823f072aabbc97014f27: Status 404 returned error can't find the container with id 157820eeb4190ca65ab4811f1990399a8b570f8eb113823f072aabbc97014f27 Jul 24 20:21:10.366338 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.366297 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n"] Jul 24 20:21:10.370158 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.370126 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.374715 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.374679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lmv5f\"" Jul 24 20:21:10.375721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.375267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 20:21:10.377809 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.375314 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 20:21:10.377968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.375351 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 20:21:10.377968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.375454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 20:21:10.392954 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.392919 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n"] Jul 24 20:21:10.425506 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.425457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75btg\" (UniqueName: \"kubernetes.io/projected/7c28ea3c-947e-410f-b727-63dcf420aab9-kube-api-access-75btg\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.425506 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.425506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.425751 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.425560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-tmp\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.425751 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.425622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.425821 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.425769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-manifests\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.476989 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.476947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" event={"ID":"d79b7dc9-88c4-4afc-8058-ba5ee683de24","Type":"ContainerStarted","Data":"157820eeb4190ca65ab4811f1990399a8b570f8eb113823f072aabbc97014f27"} Jul 24 20:21:10.526687 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.526643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-manifests\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.526687 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.526695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75btg\" (UniqueName: \"kubernetes.io/projected/7c28ea3c-947e-410f-b727-63dcf420aab9-kube-api-access-75btg\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.526957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.526822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.526957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.526885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-tmp\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.526957 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.526911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.527171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.527141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-manifests\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.529263 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.529234 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c28ea3c-947e-410f-b727-63dcf420aab9-tmp\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.529426 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.529403 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.529486 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.529447 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c28ea3c-947e-410f-b727-63dcf420aab9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.535597 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.535562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75btg\" (UniqueName: \"kubernetes.io/projected/7c28ea3c-947e-410f-b727-63dcf420aab9-kube-api-access-75btg\") pod \"opendatahub-operator-controller-manager-7c48cfcf9b-55w9n\" (UID: \"7c28ea3c-947e-410f-b727-63dcf420aab9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.685064 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.684968 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:10.867206 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:10.866856 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n"] Jul 24 20:21:10.870569 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:21:10.870523 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c28ea3c_947e_410f_b727_63dcf420aab9.slice/crio-2fdd904bfe5269d294336e124a323ccde3e759e4d94956c09b852e1e90c9d775 WatchSource:0}: Error finding container 2fdd904bfe5269d294336e124a323ccde3e759e4d94956c09b852e1e90c9d775: Status 404 returned error can't find the container with id 2fdd904bfe5269d294336e124a323ccde3e759e4d94956c09b852e1e90c9d775 Jul 24 20:21:11.486413 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:11.486316 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" event={"ID":"7c28ea3c-947e-410f-b727-63dcf420aab9","Type":"ContainerStarted","Data":"2fdd904bfe5269d294336e124a323ccde3e759e4d94956c09b852e1e90c9d775"} Jul 24 20:21:11.489229 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:11.489179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" event={"ID":"d79b7dc9-88c4-4afc-8058-ba5ee683de24","Type":"ContainerStarted","Data":"b408ce68cf14d33b26995e1d7e202b2cf533a019a634eccb003ff8729589bd04"} Jul 24 20:21:11.489419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:11.489248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:11.513127 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:11.513039 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" podStartSLOduration=1.059040222 podStartE2EDuration="2.513017122s" totalImagesPullingTime="1.4539769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:21:11.511334841 +0000 UTC m=+372.308927957" watchObservedRunningTime="2026-07-24 20:21:11.513017122 +0000 UTC m=+372.310610230" Jul 24 20:21:14.507540 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:14.507493 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" event={"ID":"7c28ea3c-947e-410f-b727-63dcf420aab9","Type":"ContainerStarted","Data":"45a971e60bd91410ce3cbea19ac0089c554a56c022bf2a16b004ca2bb936c4d6"} Jul 24 20:21:15.514346 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:15.514306 2574 generic.go:356] "Generic (PLEG): container finished" podID="7c28ea3c-947e-410f-b727-63dcf420aab9" containerID="45a971e60bd91410ce3cbea19ac0089c554a56c022bf2a16b004ca2bb936c4d6" exitCode=0 Jul 24 20:21:15.514745 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:15.514395 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" event={"ID":"7c28ea3c-947e-410f-b727-63dcf420aab9","Type":"ContainerDied","Data":"45a971e60bd91410ce3cbea19ac0089c554a56c022bf2a16b004ca2bb936c4d6"} Jul 24 20:21:16.521702 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:16.521665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" event={"ID":"7c28ea3c-947e-410f-b727-63dcf420aab9","Type":"ContainerStarted","Data":"58313143ec5af2934b844ab9d80a4885d9040c7ffbdc6d029f33435f63148716"} Jul 24 20:21:16.522170 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:16.521766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:16.545943 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:16.545886 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" podStartSLOduration=1.876208385 podStartE2EDuration="6.545866189s" totalImagesPullingTime="3.573613216s" totalInitContainerRuntime="1.096044588s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:21:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:21:16.542898583 +0000 UTC m=+377.340491716" watchObservedRunningTime="2026-07-24 20:21:16.545866189 +0000 UTC m=+377.343459293" Jul 24 20:21:22.497227 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:22.497193 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-779f8ddb8c-hrh4w" Jul 24 20:21:27.530141 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:27.530106 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c48cfcf9b-55w9n" Jul 24 20:21:37.810772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.810729 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:37.814110 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.814087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.816954 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.816922 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k9zwx\"" Jul 24 20:21:37.817122 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.817015 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 20:21:37.831377 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.831343 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:37.929965 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.929928 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8"] Jul 24 20:21:37.932713 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.932692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:37.935731 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.935707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 20:21:37.935731 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.935724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 20:21:37.935965 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.935948 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 20:21:37.936048 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.936035 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-57ww5\"" Jul 24 20:21:37.960581 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.960539 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8"] Jul 24 20:21:37.972739 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dk6j\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.972938 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.972938 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.972938 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.973061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.973061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.972992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.973061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.973020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.973061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.973049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:37.973218 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:37.973068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074091 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.073963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074091 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074328 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dk6j\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ec5e55-fe92-4047-9be0-6d5f104b4021-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074564 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074583 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk87n\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-kube-api-access-sk87n\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.074868 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074808 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.075106 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.074962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.075223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.075203 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.077511 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.077482 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.077788 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.077766 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.085271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.085236 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.085481 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.085459 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dk6j\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bck4pck\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.125284 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.125243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:38.175422 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175591 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175591 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175591 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ec5e55-fe92-4047-9be0-6d5f104b4021-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175742 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk87n\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-kube-api-access-sk87n\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175742 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.175742 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.175652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.176737 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.176406 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.178751 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.178683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6ec5e55-fe92-4047-9be0-6d5f104b4021-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.178918 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.178890 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.182326 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.180800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.183520 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.183453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.186156 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.185954 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.186156 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.186051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk87n\" (UniqueName: \"kubernetes.io/projected/f6ec5e55-fe92-4047-9be0-6d5f104b4021-kube-api-access-sk87n\") pod \"istiod-openshift-gateway-5677ccb49b-x6wb8\" (UID: \"f6ec5e55-fe92-4047-9be0-6d5f104b4021\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.243499 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.243443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:38.286012 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.285930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:38.287852 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:21:38.287816 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf06f6c_c96b_4d9e_afb2_092d18f15323.slice/crio-3e15ad5df9e13a5f558565b6f73b67ff99b452a746cb528f678a030be68c8061 WatchSource:0}: Error finding container 3e15ad5df9e13a5f558565b6f73b67ff99b452a746cb528f678a030be68c8061: Status 404 returned error can't find the container with id 3e15ad5df9e13a5f558565b6f73b67ff99b452a746cb528f678a030be68c8061 Jul 24 20:21:38.428293 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.428134 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8"] Jul 24 20:21:38.430973 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:21:38.430936 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ec5e55_fe92_4047_9be0_6d5f104b4021.slice/crio-0ff430482590ab603f01551db4febdea1cff62ccf6564d7e6d26079150de15bf WatchSource:0}: Error finding container 0ff430482590ab603f01551db4febdea1cff62ccf6564d7e6d26079150de15bf: Status 404 returned error can't find the container with id 0ff430482590ab603f01551db4febdea1cff62ccf6564d7e6d26079150de15bf Jul 24 20:21:38.633244 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.633131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" event={"ID":"0bf06f6c-c96b-4d9e-afb2-092d18f15323","Type":"ContainerStarted","Data":"3e15ad5df9e13a5f558565b6f73b67ff99b452a746cb528f678a030be68c8061"} Jul 24 20:21:38.634706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:38.634673 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" event={"ID":"f6ec5e55-fe92-4047-9be0-6d5f104b4021","Type":"ContainerStarted","Data":"0ff430482590ab603f01551db4febdea1cff62ccf6564d7e6d26079150de15bf"} Jul 24 20:21:42.313818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.313766 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:21:42.314164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.313858 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:21:42.318120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.318066 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:21:42.318224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.318155 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:21:42.318224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.318185 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:21:42.670340 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.670235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" event={"ID":"0bf06f6c-c96b-4d9e-afb2-092d18f15323","Type":"ContainerStarted","Data":"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27"} Jul 24 20:21:42.672176 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.672143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" event={"ID":"f6ec5e55-fe92-4047-9be0-6d5f104b4021","Type":"ContainerStarted","Data":"1c4e55722d040f93b090d086fd4a134337a841fe80e4e1775a1dd3dea021db9b"} Jul 24 20:21:42.672332 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.672304 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:42.712994 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.712931 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" podStartSLOduration=1.685103964 podStartE2EDuration="5.71290925s" totalImagesPullingTime="4.027805286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:21:42.71275255 +0000 UTC m=+403.510345679" watchObservedRunningTime="2026-07-24 20:21:42.71290925 +0000 UTC m=+403.510502356" Jul 24 20:21:42.751740 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:42.751678 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" podStartSLOduration=1.871277537 podStartE2EDuration="5.751658317s" totalImagesPullingTime="3.88038078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:21:42.749672193 +0000 UTC m=+403.547265297" watchObservedRunningTime="2026-07-24 20:21:42.751658317 +0000 UTC m=+403.549251421" Jul 24 20:21:43.104133 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.104092 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:43.125475 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.125433 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:43.127039 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.127010 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bck4pck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 24 20:21:43.127202 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.127085 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 24 20:21:43.679150 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.679113 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-x6wb8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 20:21:43.679559 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:43.679184 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" podUID="f6ec5e55-fe92-4047-9be0-6d5f104b4021" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 20:21:44.125639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:44.125594 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bck4pck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 24 20:21:44.125861 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:44.125652 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 24 20:21:44.682281 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:44.682227 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" containerID="cri-o://789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27" gracePeriod=30 Jul 24 20:21:46.679045 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:46.679006 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x6wb8" Jul 24 20:21:49.955349 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.955282 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:49.991817 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991779 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991824 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991862 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dk6j\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991879 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991905 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991951 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992006 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.991989 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:49.992329 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.992296 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data" (OuterVolumeSpecName: "istio-data") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:21:49.992329 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.992312 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:21:49.992479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.992458 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:21:49.992695 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.992638 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:21:49.994451 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.994422 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j" (OuterVolumeSpecName: "kube-api-access-6dk6j") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "kube-api-access-6dk6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:21:49.994590 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.994536 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:21:49.994590 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:49.994543 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:21:50.092598 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092555 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:50.092598 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092595 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs\") pod \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\" (UID: \"0bf06f6c-c96b-4d9e-afb2-092d18f15323\") " Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092725 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092737 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092747 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092756 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dk6j\" (UniqueName: \"kubernetes.io/projected/0bf06f6c-c96b-4d9e-afb2-092d18f15323-kube-api-access-6dk6j\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092780 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092788 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.092828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092796 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.093036 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.092902 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:21:50.094657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.094631 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0bf06f6c-c96b-4d9e-afb2-092d18f15323" (UID: "0bf06f6c-c96b-4d9e-afb2-092d18f15323"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:21:50.193353 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.193298 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.193353 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.193343 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bf06f6c-c96b-4d9e-afb2-092d18f15323-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:21:50.712664 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.712623 2574 generic.go:356] "Generic (PLEG): container finished" podID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerID="789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27" exitCode=0 Jul 24 20:21:50.712927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.712678 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" Jul 24 20:21:50.712927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.712711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" event={"ID":"0bf06f6c-c96b-4d9e-afb2-092d18f15323","Type":"ContainerDied","Data":"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27"} Jul 24 20:21:50.712927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.712795 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck" event={"ID":"0bf06f6c-c96b-4d9e-afb2-092d18f15323","Type":"ContainerDied","Data":"3e15ad5df9e13a5f558565b6f73b67ff99b452a746cb528f678a030be68c8061"} Jul 24 20:21:50.712927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.712828 2574 scope.go:117] "RemoveContainer" containerID="789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27" Jul 24 20:21:50.723677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.723654 2574 scope.go:117] "RemoveContainer" containerID="789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27" Jul 24 20:21:50.724007 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:21:50.723989 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27\": container with ID starting with 789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27 not found: ID does not exist" containerID="789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27" Jul 24 20:21:50.724053 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.724016 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27"} err="failed to get container status \"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27\": rpc error: code = NotFound desc = could not find container \"789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27\": container with ID starting with 789a434a0386a509d932b9b1170d047002571e5e28c06346ad3f6f5c5b6cbe27 not found: ID does not exist" Jul 24 20:21:50.735456 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.735418 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:50.739474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:50.739442 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bck4pck"] Jul 24 20:21:51.715495 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:21:51.715460 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" path="/var/lib/kubelet/pods/0bf06f6c-c96b-4d9e-afb2-092d18f15323/volumes" Jul 24 20:22:49.924370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.924328 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv"] Jul 24 20:22:49.924869 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.924678 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" Jul 24 20:22:49.924869 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.924689 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" Jul 24 20:22:49.924869 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.924748 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bf06f6c-c96b-4d9e-afb2-092d18f15323" containerName="istio-proxy" Jul 24 20:22:49.927125 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.927095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:49.929967 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.929938 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 20:22:49.930913 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.930892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9vz6v\"" Jul 24 20:22:49.931025 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.930917 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 20:22:49.937390 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:49.937263 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv"] Jul 24 20:22:50.001049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.001011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.001260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.001058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4swl\" (UniqueName: \"kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.001260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.001136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.019742 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.019704 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s"] Jul 24 20:22:50.022653 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.022630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.031814 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.031779 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s"] Jul 24 20:22:50.101812 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.101812 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4swl\" (UniqueName: \"kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.102132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v97gd\" (UniqueName: \"kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.102132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.102132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.102132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.101948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.102355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.102309 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.102355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.102308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.111110 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.111054 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4swl\" (UniqueName: \"kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.202710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.202577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.202710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.202658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.202710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.202691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v97gd\" (UniqueName: \"kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.203130 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.203107 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.203209 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.203162 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.211541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.211512 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v97gd\" (UniqueName: \"kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.244385 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.244340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:50.324062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.324027 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn"] Jul 24 20:22:50.326721 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.326698 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.332750 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.332721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:50.338989 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.338528 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn"] Jul 24 20:22:50.402794 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.402497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv"] Jul 24 20:22:50.404346 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.404313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq6lq\" (UniqueName: \"kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.404490 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.404386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.404490 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.404467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.495134 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.495091 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s"] Jul 24 20:22:50.496536 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:22:50.496497 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf50178_8981_4a0e_9d19_f4241ffb1d51.slice/crio-0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95 WatchSource:0}: Error finding container 0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95: Status 404 returned error can't find the container with id 0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95 Jul 24 20:22:50.508406 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.508372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.508605 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.508480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq6lq\" (UniqueName: \"kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.508605 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.508520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.508840 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.508818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.508909 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.508849 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.519896 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.519867 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq6lq\" (UniqueName: \"kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.641062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.641023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:50.725724 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.725640 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk"] Jul 24 20:22:50.728236 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.728211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.739191 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.738893 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk"] Jul 24 20:22:50.788689 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.788525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn"] Jul 24 20:22:50.791377 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:22:50.791346 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b350a1_5727_468a_b81b_44b1dd28da27.slice/crio-89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236 WatchSource:0}: Error finding container 89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236: Status 404 returned error can't find the container with id 89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236 Jul 24 20:22:50.810987 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.810961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.811151 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.811111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.811151 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.811142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjfw\" (UniqueName: \"kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.912446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.912404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.912446 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.912448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjfw\" (UniqueName: \"kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.912680 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.912492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.912851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.912832 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.912893 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.912839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:50.921714 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:50.921683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjfw\" (UniqueName: \"kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:51.008458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.008417 2574 generic.go:356] "Generic (PLEG): container finished" podID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerID="03046780e9c6c7ad9934590ec91f163ec134c8abf25e27f3964a97afd17453d4" exitCode=0 Jul 24 20:22:51.008935 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.008497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" event={"ID":"bcf50178-8981-4a0e-9d19-f4241ffb1d51","Type":"ContainerDied","Data":"03046780e9c6c7ad9934590ec91f163ec134c8abf25e27f3964a97afd17453d4"} Jul 24 20:22:51.008935 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.008552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" event={"ID":"bcf50178-8981-4a0e-9d19-f4241ffb1d51","Type":"ContainerStarted","Data":"0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95"} Jul 24 20:22:51.010454 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.010428 2574 generic.go:356] "Generic (PLEG): container finished" podID="05b350a1-5727-468a-b81b-44b1dd28da27" containerID="36983146c66e4a2ec32d55552c7496c2fb52e1b40cea553017f7c94d6469a366" exitCode=0 Jul 24 20:22:51.010571 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.010541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" event={"ID":"05b350a1-5727-468a-b81b-44b1dd28da27","Type":"ContainerDied","Data":"36983146c66e4a2ec32d55552c7496c2fb52e1b40cea553017f7c94d6469a366"} Jul 24 20:22:51.010653 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.010592 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" event={"ID":"05b350a1-5727-468a-b81b-44b1dd28da27","Type":"ContainerStarted","Data":"89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236"} Jul 24 20:22:51.012375 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.012350 2574 generic.go:356] "Generic (PLEG): container finished" podID="28af354f-a201-43a6-b602-2bc1df92811b" containerID="19a61a5fb5160a926026c8cccf5f609b549c8fc02f056a7ab5b3939a56507759" exitCode=0 Jul 24 20:22:51.012450 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.012388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" event={"ID":"28af354f-a201-43a6-b602-2bc1df92811b","Type":"ContainerDied","Data":"19a61a5fb5160a926026c8cccf5f609b549c8fc02f056a7ab5b3939a56507759"} Jul 24 20:22:51.012450 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.012433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" event={"ID":"28af354f-a201-43a6-b602-2bc1df92811b","Type":"ContainerStarted","Data":"7dfc1ac011ecf76e72eaf67dd5c7885b040eae9c8017087e620c0858b30aa588"} Jul 24 20:22:51.042153 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.042115 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:51.188954 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:51.188925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk"] Jul 24 20:22:51.191437 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:22:51.191408 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf07a1e_191d_4001_a931_89e5cba08e9b.slice/crio-c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa WatchSource:0}: Error finding container c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa: Status 404 returned error can't find the container with id c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa Jul 24 20:22:52.020390 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:52.020352 2574 generic.go:356] "Generic (PLEG): container finished" podID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerID="265ecbf5999d1ddeff759c72fab54044db8474f68e3ee9f00afda1b99e7124a1" exitCode=0 Jul 24 20:22:52.020900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:52.020428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" event={"ID":"3cf07a1e-191d-4001-a931-89e5cba08e9b","Type":"ContainerDied","Data":"265ecbf5999d1ddeff759c72fab54044db8474f68e3ee9f00afda1b99e7124a1"} Jul 24 20:22:52.020900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:52.020487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" event={"ID":"3cf07a1e-191d-4001-a931-89e5cba08e9b","Type":"ContainerStarted","Data":"c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa"} Jul 24 20:22:53.028617 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.028577 2574 generic.go:356] "Generic (PLEG): container finished" podID="05b350a1-5727-468a-b81b-44b1dd28da27" containerID="cd31d44ee546cb5bb2df890d901c5f76efa3c3640e5ee205e650f34b73403e8c" exitCode=0 Jul 24 20:22:53.029060 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.028674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" event={"ID":"05b350a1-5727-468a-b81b-44b1dd28da27","Type":"ContainerDied","Data":"cd31d44ee546cb5bb2df890d901c5f76efa3c3640e5ee205e650f34b73403e8c"} Jul 24 20:22:53.030761 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.030730 2574 generic.go:356] "Generic (PLEG): container finished" podID="28af354f-a201-43a6-b602-2bc1df92811b" containerID="27993216a062395edd24aea5d07cefa9999840b93c36357c2d4f4caeb080a3fa" exitCode=0 Jul 24 20:22:53.030862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.030819 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" event={"ID":"28af354f-a201-43a6-b602-2bc1df92811b","Type":"ContainerDied","Data":"27993216a062395edd24aea5d07cefa9999840b93c36357c2d4f4caeb080a3fa"} Jul 24 20:22:53.032896 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.032872 2574 generic.go:356] "Generic (PLEG): container finished" podID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerID="47c583d710f37dc39a9cf241506a3fc8282ceb64cd60985878f4822c1aaebee1" exitCode=0 Jul 24 20:22:53.032981 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.032955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" event={"ID":"bcf50178-8981-4a0e-9d19-f4241ffb1d51","Type":"ContainerDied","Data":"47c583d710f37dc39a9cf241506a3fc8282ceb64cd60985878f4822c1aaebee1"} Jul 24 20:22:53.035174 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.035150 2574 generic.go:356] "Generic (PLEG): container finished" podID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerID="0cbdaa877f905382d36141b5dc42361f23b315f21c1feb70f45dc5b8c819cb46" exitCode=0 Jul 24 20:22:53.035270 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:53.035183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" event={"ID":"3cf07a1e-191d-4001-a931-89e5cba08e9b","Type":"ContainerDied","Data":"0cbdaa877f905382d36141b5dc42361f23b315f21c1feb70f45dc5b8c819cb46"} Jul 24 20:22:54.042154 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.042115 2574 generic.go:356] "Generic (PLEG): container finished" podID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerID="315b93b4368064f30de8ddbf552fc05a7384cd67b09b0b39f80485f197372e3b" exitCode=0 Jul 24 20:22:54.042616 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.042206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" event={"ID":"bcf50178-8981-4a0e-9d19-f4241ffb1d51","Type":"ContainerDied","Data":"315b93b4368064f30de8ddbf552fc05a7384cd67b09b0b39f80485f197372e3b"} Jul 24 20:22:54.050363 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.050325 2574 generic.go:356] "Generic (PLEG): container finished" podID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerID="3ad3adbe5e0399df22bd199a58f9d47d519c228ce8d5509ba9183a6ac1540805" exitCode=0 Jul 24 20:22:54.050542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.050496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" event={"ID":"3cf07a1e-191d-4001-a931-89e5cba08e9b","Type":"ContainerDied","Data":"3ad3adbe5e0399df22bd199a58f9d47d519c228ce8d5509ba9183a6ac1540805"} Jul 24 20:22:54.052991 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.052953 2574 generic.go:356] "Generic (PLEG): container finished" podID="05b350a1-5727-468a-b81b-44b1dd28da27" containerID="a55185f1874da6eb082c35c0dd4e34a229404ba721af4b5f793f06a10080347f" exitCode=0 Jul 24 20:22:54.053175 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.053029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" event={"ID":"05b350a1-5727-468a-b81b-44b1dd28da27","Type":"ContainerDied","Data":"a55185f1874da6eb082c35c0dd4e34a229404ba721af4b5f793f06a10080347f"} Jul 24 20:22:54.055063 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.055036 2574 generic.go:356] "Generic (PLEG): container finished" podID="28af354f-a201-43a6-b602-2bc1df92811b" containerID="fa39c9dc8bbb64369e1149889d57687e6e66031c20d815995eb5516ef6453ebf" exitCode=0 Jul 24 20:22:54.055189 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:54.055103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" event={"ID":"28af354f-a201-43a6-b602-2bc1df92811b","Type":"ContainerDied","Data":"fa39c9dc8bbb64369e1149889d57687e6e66031c20d815995eb5516ef6453ebf"} Jul 24 20:22:55.243521 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.243488 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:55.274461 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.274430 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:55.289570 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.289542 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:55.297268 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.297241 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:55.354848 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354756 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util\") pod \"05b350a1-5727-468a-b81b-44b1dd28da27\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " Jul 24 20:22:55.354848 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354811 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq6lq\" (UniqueName: \"kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq\") pod \"05b350a1-5727-468a-b81b-44b1dd28da27\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " Jul 24 20:22:55.354848 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354848 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle\") pod \"3cf07a1e-191d-4001-a931-89e5cba08e9b\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354892 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle\") pod \"05b350a1-5727-468a-b81b-44b1dd28da27\" (UID: \"05b350a1-5727-468a-b81b-44b1dd28da27\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354921 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle\") pod \"28af354f-a201-43a6-b602-2bc1df92811b\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354961 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util\") pod \"3cf07a1e-191d-4001-a931-89e5cba08e9b\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.354987 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjjfw\" (UniqueName: \"kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw\") pod \"3cf07a1e-191d-4001-a931-89e5cba08e9b\" (UID: \"3cf07a1e-191d-4001-a931-89e5cba08e9b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355029 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util\") pod \"28af354f-a201-43a6-b602-2bc1df92811b\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355056 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util\") pod \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355124 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4swl\" (UniqueName: \"kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl\") pod \"28af354f-a201-43a6-b602-2bc1df92811b\" (UID: \"28af354f-a201-43a6-b602-2bc1df92811b\") " Jul 24 20:22:55.355164 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle\") pod \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " Jul 24 20:22:55.355559 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355199 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v97gd\" (UniqueName: \"kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd\") pod \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\" (UID: \"bcf50178-8981-4a0e-9d19-f4241ffb1d51\") " Jul 24 20:22:55.355770 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355736 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle" (OuterVolumeSpecName: "bundle") pod "28af354f-a201-43a6-b602-2bc1df92811b" (UID: "28af354f-a201-43a6-b602-2bc1df92811b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.355851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355769 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle" (OuterVolumeSpecName: "bundle") pod "3cf07a1e-191d-4001-a931-89e5cba08e9b" (UID: "3cf07a1e-191d-4001-a931-89e5cba08e9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.355994 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.355963 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle" (OuterVolumeSpecName: "bundle") pod "05b350a1-5727-468a-b81b-44b1dd28da27" (UID: "05b350a1-5727-468a-b81b-44b1dd28da27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.357870 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.357830 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq" (OuterVolumeSpecName: "kube-api-access-rq6lq") pod "05b350a1-5727-468a-b81b-44b1dd28da27" (UID: "05b350a1-5727-468a-b81b-44b1dd28da27"). InnerVolumeSpecName "kube-api-access-rq6lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:22:55.358056 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.358029 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd" (OuterVolumeSpecName: "kube-api-access-v97gd") pod "bcf50178-8981-4a0e-9d19-f4241ffb1d51" (UID: "bcf50178-8981-4a0e-9d19-f4241ffb1d51"). InnerVolumeSpecName "kube-api-access-v97gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:22:55.358279 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.358255 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl" (OuterVolumeSpecName: "kube-api-access-z4swl") pod "28af354f-a201-43a6-b602-2bc1df92811b" (UID: "28af354f-a201-43a6-b602-2bc1df92811b"). InnerVolumeSpecName "kube-api-access-z4swl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:22:55.358467 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.358443 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle" (OuterVolumeSpecName: "bundle") pod "bcf50178-8981-4a0e-9d19-f4241ffb1d51" (UID: "bcf50178-8981-4a0e-9d19-f4241ffb1d51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.358889 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.358865 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw" (OuterVolumeSpecName: "kube-api-access-qjjfw") pod "3cf07a1e-191d-4001-a931-89e5cba08e9b" (UID: "3cf07a1e-191d-4001-a931-89e5cba08e9b"). InnerVolumeSpecName "kube-api-access-qjjfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:22:55.362325 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.362289 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util" (OuterVolumeSpecName: "util") pod "3cf07a1e-191d-4001-a931-89e5cba08e9b" (UID: "3cf07a1e-191d-4001-a931-89e5cba08e9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.362904 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.362880 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util" (OuterVolumeSpecName: "util") pod "28af354f-a201-43a6-b602-2bc1df92811b" (UID: "28af354f-a201-43a6-b602-2bc1df92811b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.363986 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.363954 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util" (OuterVolumeSpecName: "util") pod "05b350a1-5727-468a-b81b-44b1dd28da27" (UID: "05b350a1-5727-468a-b81b-44b1dd28da27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.365083 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.365053 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util" (OuterVolumeSpecName: "util") pod "bcf50178-8981-4a0e-9d19-f4241ffb1d51" (UID: "bcf50178-8981-4a0e-9d19-f4241ffb1d51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:22:55.456150 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456110 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4swl\" (UniqueName: \"kubernetes.io/projected/28af354f-a201-43a6-b602-2bc1df92811b-kube-api-access-z4swl\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456150 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456143 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456150 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456154 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v97gd\" (UniqueName: \"kubernetes.io/projected/bcf50178-8981-4a0e-9d19-f4241ffb1d51-kube-api-access-v97gd\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456150 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456164 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456174 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq6lq\" (UniqueName: \"kubernetes.io/projected/05b350a1-5727-468a-b81b-44b1dd28da27-kube-api-access-rq6lq\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456182 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456190 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05b350a1-5727-468a-b81b-44b1dd28da27-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456197 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456204 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cf07a1e-191d-4001-a931-89e5cba08e9b-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456211 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjjfw\" (UniqueName: \"kubernetes.io/projected/3cf07a1e-191d-4001-a931-89e5cba08e9b-kube-api-access-qjjfw\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456219 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28af354f-a201-43a6-b602-2bc1df92811b-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:55.456425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:55.456227 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcf50178-8981-4a0e-9d19-f4241ffb1d51-util\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:22:56.068575 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.068543 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" Jul 24 20:22:56.068784 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.068540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn" event={"ID":"05b350a1-5727-468a-b81b-44b1dd28da27","Type":"ContainerDied","Data":"89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236"} Jul 24 20:22:56.068784 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.068670 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89a4e7490f24cd39218ec436c1c2d4f941db460db33ac24b007163a955bcf236" Jul 24 20:22:56.070666 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.070627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" event={"ID":"28af354f-a201-43a6-b602-2bc1df92811b","Type":"ContainerDied","Data":"7dfc1ac011ecf76e72eaf67dd5c7885b040eae9c8017087e620c0858b30aa588"} Jul 24 20:22:56.070843 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.070688 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dfc1ac011ecf76e72eaf67dd5c7885b040eae9c8017087e620c0858b30aa588" Jul 24 20:22:56.070843 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.070647 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv" Jul 24 20:22:56.072989 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.072929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" event={"ID":"bcf50178-8981-4a0e-9d19-f4241ffb1d51","Type":"ContainerDied","Data":"0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95"} Jul 24 20:22:56.073151 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.073011 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fb60bc4bd4002ced9a04c49856f947842dc20cbb9862e344d5f6d8fefa57b95" Jul 24 20:22:56.073151 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.073022 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s" Jul 24 20:22:56.075158 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.075123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" event={"ID":"3cf07a1e-191d-4001-a931-89e5cba08e9b","Type":"ContainerDied","Data":"c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa"} Jul 24 20:22:56.075338 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.075157 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk" Jul 24 20:22:56.075338 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:22:56.075176 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7b64faf219be9b14c7bbdb181f465125e6c9967e76e6abb61cae6c4c9a022aa" Jul 24 20:23:10.260316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260276 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64cf554964-ch525"] Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260794 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260817 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260830 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260840 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260853 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="util" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260861 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="util" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260872 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260880 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="extract" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260895 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="pull" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260903 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="pull" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260914 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="util" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260921 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="util" Jul 24 20:23:10.260923 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260931 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260939 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260954 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="util" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260961 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="util" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260971 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="util" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260979 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="util" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.260997 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261005 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261018 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261027 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="pull" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261044 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="extract" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261052 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="extract" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261165 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b350a1-5727-468a-b81b-44b1dd28da27" containerName="extract" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261176 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="28af354f-a201-43a6-b602-2bc1df92811b" containerName="extract" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261187 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf50178-8981-4a0e-9d19-f4241ffb1d51" containerName="extract" Jul 24 20:23:10.261572 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.261199 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf07a1e-191d-4001-a931-89e5cba08e9b" containerName="extract" Jul 24 20:23:10.265986 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.265957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.276336 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.276302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cf554964-ch525"] Jul 24 20:23:10.391474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-oauth-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-console-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-service-ca\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t67r\" (UniqueName: \"kubernetes.io/projected/1916df96-4d3c-46a1-9c11-4373b26e944f-kube-api-access-7t67r\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391841 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-oauth-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391841 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.391841 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.391812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-trusted-ca-bundle\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493346 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493346 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-trusted-ca-bundle\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-oauth-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-console-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-service-ca\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t67r\" (UniqueName: \"kubernetes.io/projected/1916df96-4d3c-46a1-9c11-4373b26e944f-kube-api-access-7t67r\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.493580 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.493565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-oauth-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.494263 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.494233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-console-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.494397 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.494233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-oauth-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.494397 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.494295 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-service-ca\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.494522 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.494475 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1916df96-4d3c-46a1-9c11-4373b26e944f-trusted-ca-bundle\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.496132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.496108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-oauth-config\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.496225 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.496113 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1916df96-4d3c-46a1-9c11-4373b26e944f-console-serving-cert\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.506058 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.506027 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t67r\" (UniqueName: \"kubernetes.io/projected/1916df96-4d3c-46a1-9c11-4373b26e944f-kube-api-access-7t67r\") pod \"console-64cf554964-ch525\" (UID: \"1916df96-4d3c-46a1-9c11-4373b26e944f\") " pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.578100 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.577977 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:10.726628 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:10.726597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64cf554964-ch525"] Jul 24 20:23:10.728567 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:23:10.728539 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1916df96_4d3c_46a1_9c11_4373b26e944f.slice/crio-1a781803887d3867071b3ff7571017731f57bc27522451b72d1fe09acb7f2924 WatchSource:0}: Error finding container 1a781803887d3867071b3ff7571017731f57bc27522451b72d1fe09acb7f2924: Status 404 returned error can't find the container with id 1a781803887d3867071b3ff7571017731f57bc27522451b72d1fe09acb7f2924 Jul 24 20:23:11.152513 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:11.152466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cf554964-ch525" event={"ID":"1916df96-4d3c-46a1-9c11-4373b26e944f","Type":"ContainerStarted","Data":"72ad338c3371721b4f255fadb01d844b0b0338989e10f51ad0532652bb80a568"} Jul 24 20:23:11.152697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:11.152532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64cf554964-ch525" event={"ID":"1916df96-4d3c-46a1-9c11-4373b26e944f","Type":"ContainerStarted","Data":"1a781803887d3867071b3ff7571017731f57bc27522451b72d1fe09acb7f2924"} Jul 24 20:23:11.172848 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:11.172789 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64cf554964-ch525" podStartSLOduration=1.172769861 podStartE2EDuration="1.172769861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:23:11.171831297 +0000 UTC m=+491.969424427" watchObservedRunningTime="2026-07-24 20:23:11.172769861 +0000 UTC m=+491.970362966" Jul 24 20:23:20.578427 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:20.578386 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:20.579104 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:20.578448 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:20.583599 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:20.583566 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:21.208525 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:21.208491 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64cf554964-ch525" Jul 24 20:23:21.265266 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:21.265218 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:23:37.335113 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.335004 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr"] Jul 24 20:23:37.340347 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.340319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:37.343499 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.343471 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 20:23:37.343676 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.343521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 20:23:37.344689 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.344669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kzxq2\"" Jul 24 20:23:37.352037 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.351996 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr"] Jul 24 20:23:37.431915 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.431871 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbsn\" (UniqueName: \"kubernetes.io/projected/f91c73e4-0103-46f1-93e5-883d0a54cf1b-kube-api-access-htbsn\") pod \"limitador-operator-controller-manager-859d7b78bd-nrcnr\" (UID: \"f91c73e4-0103-46f1-93e5-883d0a54cf1b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:37.532879 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.532831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbsn\" (UniqueName: \"kubernetes.io/projected/f91c73e4-0103-46f1-93e5-883d0a54cf1b-kube-api-access-htbsn\") pod \"limitador-operator-controller-manager-859d7b78bd-nrcnr\" (UID: \"f91c73e4-0103-46f1-93e5-883d0a54cf1b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:37.543311 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.543286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbsn\" (UniqueName: \"kubernetes.io/projected/f91c73e4-0103-46f1-93e5-883d0a54cf1b-kube-api-access-htbsn\") pod \"limitador-operator-controller-manager-859d7b78bd-nrcnr\" (UID: \"f91c73e4-0103-46f1-93e5-883d0a54cf1b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:37.655965 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.655864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:37.808558 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:37.808493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr"] Jul 24 20:23:37.810922 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:23:37.810880 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91c73e4_0103_46f1_93e5_883d0a54cf1b.slice/crio-48cf1d328f22c3004368a521f80961a37abc1cfe021a49289437d1996a85e60b WatchSource:0}: Error finding container 48cf1d328f22c3004368a521f80961a37abc1cfe021a49289437d1996a85e60b: Status 404 returned error can't find the container with id 48cf1d328f22c3004368a521f80961a37abc1cfe021a49289437d1996a85e60b Jul 24 20:23:38.304975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:38.304942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" event={"ID":"f91c73e4-0103-46f1-93e5-883d0a54cf1b","Type":"ContainerStarted","Data":"48cf1d328f22c3004368a521f80961a37abc1cfe021a49289437d1996a85e60b"} Jul 24 20:23:40.317767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:40.317725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" event={"ID":"f91c73e4-0103-46f1-93e5-883d0a54cf1b","Type":"ContainerStarted","Data":"8db9f57f7d1bdc82108ea7e2364585fc7f0a93b0c16e1fb23ba36b916fd1cfee"} Jul 24 20:23:40.318258 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:40.317877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:23:40.336912 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:40.336854 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" podStartSLOduration=1.693276875 podStartE2EDuration="3.33683699s" totalImagesPullingTime="1.643560115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:23:40.335308749 +0000 UTC m=+521.132901853" watchObservedRunningTime="2026-07-24 20:23:40.33683699 +0000 UTC m=+521.134430095" Jul 24 20:23:46.290551 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.290507 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64f7bf74cc-bgvdv" podUID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" containerName="console" containerID="cri-o://b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c" gracePeriod=15 Jul 24 20:23:46.557972 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.557941 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:23:46.615733 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.615692 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.615963 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.615757 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.615963 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.615788 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.615963 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.615817 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.615963 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.615837 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.616204 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616015 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r47cs\" (UniqueName: \"kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.616204 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616059 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert\") pod \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\" (UID: \"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0\") " Jul 24 20:23:46.616204 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616180 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:23:46.616366 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616313 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:23:46.616366 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616322 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:23:46.616472 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616398 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config" (OuterVolumeSpecName: "console-config") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:23:46.616573 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616554 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-oauth-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.616612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616579 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-trusted-ca-bundle\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.616612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616595 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.616612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.616609 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.618337 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.618310 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:23:46.618444 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.618331 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 20:23:46.618444 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.618394 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs" (OuterVolumeSpecName: "kube-api-access-r47cs") pod "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" (UID: "d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0"). InnerVolumeSpecName "kube-api-access-r47cs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:23:46.717389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.717346 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r47cs\" (UniqueName: \"kubernetes.io/projected/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-kube-api-access-r47cs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.717389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.717381 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-serving-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:46.717389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:46.717391 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0-console-oauth-config\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:23:47.356626 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.356591 2574 generic.go:356] "Generic (PLEG): container finished" podID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" containerID="b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c" exitCode=0 Jul 24 20:23:47.357131 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.356636 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f7bf74cc-bgvdv" Jul 24 20:23:47.357131 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.356672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f7bf74cc-bgvdv" event={"ID":"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0","Type":"ContainerDied","Data":"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c"} Jul 24 20:23:47.357131 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.356721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f7bf74cc-bgvdv" event={"ID":"d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0","Type":"ContainerDied","Data":"925d6ab42a351dc71d13acdcad0618d9e49d2dda9e203cd2e58f4aac2a85f359"} Jul 24 20:23:47.357131 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.356742 2574 scope.go:117] "RemoveContainer" containerID="b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c" Jul 24 20:23:47.366477 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.366456 2574 scope.go:117] "RemoveContainer" containerID="b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c" Jul 24 20:23:47.366810 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:23:47.366789 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c\": container with ID starting with b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c not found: ID does not exist" containerID="b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c" Jul 24 20:23:47.366877 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.366822 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c"} err="failed to get container status \"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c\": rpc error: code = NotFound desc = could not find container \"b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c\": container with ID starting with b29d529ade0681b61263f5bb2d7b9dd651baf30eef47eb9d69c8a50d2826a39c not found: ID does not exist" Jul 24 20:23:47.379339 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.379300 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:23:47.382746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.382712 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64f7bf74cc-bgvdv"] Jul 24 20:23:47.714245 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:47.714153 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" path="/var/lib/kubelet/pods/d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0/volumes" Jul 24 20:23:51.325707 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:23:51.325629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nrcnr" Jul 24 20:24:59.667768 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:24:59.667733 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:24:59.671362 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:24:59.671335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:25:51.510268 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.510226 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7"] Jul 24 20:25:51.510710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.510593 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" containerName="console" Jul 24 20:25:51.510710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.510606 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" containerName="console" Jul 24 20:25:51.510710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.510686 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41b5e6e-a6ee-49fe-bdc3-8cd98c1559a0" containerName="console" Jul 24 20:25:51.513862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.513841 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.516824 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.516800 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 20:25:51.516976 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.516835 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 20:25:51.517767 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.517737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 20:25:51.517901 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.517787 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q65fn\"" Jul 24 20:25:51.525049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.525017 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7"] Jul 24 20:25:51.628411 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.628602 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.628602 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6b84fa-813b-43ba-80ed-3d94736846d3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.628602 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.628602 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.628602 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.628584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k69t\" (UniqueName: \"kubernetes.io/projected/4b6b84fa-813b-43ba-80ed-3d94736846d3-kube-api-access-7k69t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730137 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k69t\" (UniqueName: \"kubernetes.io/projected/4b6b84fa-813b-43ba-80ed-3d94736846d3-kube-api-access-7k69t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6b84fa-813b-43ba-80ed-3d94736846d3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730359 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730631 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730700 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.730700 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.730685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.732585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.732563 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6b84fa-813b-43ba-80ed-3d94736846d3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.732983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.732962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6b84fa-813b-43ba-80ed-3d94736846d3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.741011 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.740983 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k69t\" (UniqueName: \"kubernetes.io/projected/4b6b84fa-813b-43ba-80ed-3d94736846d3-kube-api-access-7k69t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7\" (UID: \"4b6b84fa-813b-43ba-80ed-3d94736846d3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.826172 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.826045 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:25:51.977002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.976964 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7"] Jul 24 20:25:51.980093 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:25:51.980047 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6b84fa_813b_43ba_80ed_3d94736846d3.slice/crio-6b07e0db6bc91c47bef957e337ca807734a8dbefb9c64159ef42257c3d60cfeb WatchSource:0}: Error finding container 6b07e0db6bc91c47bef957e337ca807734a8dbefb9c64159ef42257c3d60cfeb: Status 404 returned error can't find the container with id 6b07e0db6bc91c47bef957e337ca807734a8dbefb9c64159ef42257c3d60cfeb Jul 24 20:25:51.981389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:51.981364 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 20:25:52.020461 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:52.020424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" event={"ID":"4b6b84fa-813b-43ba-80ed-3d94736846d3","Type":"ContainerStarted","Data":"6b07e0db6bc91c47bef957e337ca807734a8dbefb9c64159ef42257c3d60cfeb"} Jul 24 20:25:54.033753 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:54.033713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" event={"ID":"4b6b84fa-813b-43ba-80ed-3d94736846d3","Type":"ContainerStarted","Data":"9b63c21e5224fe9d412bcab46aae43c3bdcce4044a91f9c28e4de96861471887"} Jul 24 20:25:54.050497 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:25:54.050431 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" podStartSLOduration=1.90347452 podStartE2EDuration="3.050410416s" totalImagesPullingTime="1.146935896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:25:54.050136194 +0000 UTC m=+654.847729311" watchObservedRunningTime="2026-07-24 20:25:54.050410416 +0000 UTC m=+654.848003522" Jul 24 20:26:01.826595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:01.826549 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:26:01.827010 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:01.826629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:26:01.839391 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:01.839349 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:26:02.088807 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:02.088700 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7" Jul 24 20:26:20.899214 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.899170 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82"] Jul 24 20:26:20.903620 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.903590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.906347 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.906319 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 24 20:26:20.911969 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.911671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82"] Jul 24 20:26:20.997940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.997900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.997940 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.997938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-kube-api-access-2dchw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.998253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.997969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.998253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.998056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.998253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.998147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:20.998253 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:20.998174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099476 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099703 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099703 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099703 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-kube-api-access-2dchw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099885 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099885 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.099990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.099943 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.100165 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.100136 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.100165 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.100152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.102167 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.102140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.102464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.102443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.108262 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.108234 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/23b10dfb-4cd8-4e13-a7ed-9e040d28a295-kube-api-access-2dchw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82\" (UID: \"23b10dfb-4cd8-4e13-a7ed-9e040d28a295\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.216211 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.216114 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:21.360576 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:21.360545 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82"] Jul 24 20:26:21.362641 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:26:21.362599 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b10dfb_4cd8_4e13_a7ed_9e040d28a295.slice/crio-4b7940231a363ce96b3ac8d2e95f0a53ef55c2f5b61e59125dd2eb5f99c45960 WatchSource:0}: Error finding container 4b7940231a363ce96b3ac8d2e95f0a53ef55c2f5b61e59125dd2eb5f99c45960: Status 404 returned error can't find the container with id 4b7940231a363ce96b3ac8d2e95f0a53ef55c2f5b61e59125dd2eb5f99c45960 Jul 24 20:26:22.179760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:22.179721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" event={"ID":"23b10dfb-4cd8-4e13-a7ed-9e040d28a295","Type":"ContainerStarted","Data":"8e3a969fca414e98999791e3cf97df8fceb68e80d30f040a9510dc99ec5fe84b"} Jul 24 20:26:22.180225 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:22.179782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" event={"ID":"23b10dfb-4cd8-4e13-a7ed-9e040d28a295","Type":"ContainerStarted","Data":"4b7940231a363ce96b3ac8d2e95f0a53ef55c2f5b61e59125dd2eb5f99c45960"} Jul 24 20:26:22.198777 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:22.198716 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" podStartSLOduration=2.024647836 podStartE2EDuration="2.198695752s" totalImagesPullingTime="174.047916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:26:22.197815224 +0000 UTC m=+682.995408331" watchObservedRunningTime="2026-07-24 20:26:22.198695752 +0000 UTC m=+682.996288858" Jul 24 20:26:31.217247 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:31.217201 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:31.217669 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:31.217280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:31.230411 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:31.230377 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:26:31.241941 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:26:31.241909 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82" Jul 24 20:29:59.710145 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:29:59.710044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:29:59.710706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:29:59.710212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:34:59.752728 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:34:59.752698 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:34:59.755520 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:34:59.755496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:39:59.787409 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:39:59.787379 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:39:59.791466 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:39:59.791439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:42:20.439710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.439618 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:42:20.443479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.443457 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.446162 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.446140 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8c1aeab3-openshift-default-dockercfg-fh8xc\"" Jul 24 20:42:20.464035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.463997 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:42:20.532479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532685 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532685 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532685 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532685 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532858 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvft5\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532858 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532858 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.532965 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.532879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvft5\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.633961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634267 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.633987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634267 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634468 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634465 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634706 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634682 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634854 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.634854 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.634821 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.636606 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.636583 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.636718 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.636610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.641545 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.641516 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.641656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.641606 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvft5\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5\") pod \"e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.754439 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.754346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:20.910788 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.910757 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:42:20.913412 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:42:20.913373 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9eb802_ee4d_4824_b2e8_3107a21ed880.slice/crio-2a6da3b3af6a7afaa3321086525cd545fafe5a9c1b2bd2c7452d7f7041dcc47a WatchSource:0}: Error finding container 2a6da3b3af6a7afaa3321086525cd545fafe5a9c1b2bd2c7452d7f7041dcc47a: Status 404 returned error can't find the container with id 2a6da3b3af6a7afaa3321086525cd545fafe5a9c1b2bd2c7452d7f7041dcc47a Jul 24 20:42:20.915621 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.915589 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:20.915695 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.915655 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:20.915695 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:20.915684 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:21.344398 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:21.344357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerStarted","Data":"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244"} Jul 24 20:42:21.344585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:21.344454 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerStarted","Data":"2a6da3b3af6a7afaa3321086525cd545fafe5a9c1b2bd2c7452d7f7041dcc47a"} Jul 24 20:42:21.365875 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:21.365818 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podStartSLOduration=1.365802828 podStartE2EDuration="1.365802828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:42:21.364179374 +0000 UTC m=+1642.161772507" watchObservedRunningTime="2026-07-24 20:42:21.365802828 +0000 UTC m=+1642.163395933" Jul 24 20:42:21.754802 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:21.754696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:21.760058 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:21.760029 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:22.349726 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:22.349687 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:22.350660 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:22.350639 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:37.351342 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.351302 2574 patch_prober.go:28] interesting pod/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 24 20:42:37.351792 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.351364 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 24 20:42:37.434360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.434268 2574 generic.go:356] "Generic (PLEG): container finished" podID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerID="97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244" exitCode=0 Jul 24 20:42:37.434529 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.434343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerDied","Data":"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244"} Jul 24 20:42:37.434774 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.434757 2574 scope.go:117] "RemoveContainer" containerID="97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244" Jul 24 20:42:37.435914 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.435882 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:37.435974 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.435959 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:37.436011 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:37.435990 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:42:38.445620 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:38.444846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerStarted","Data":"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813"} Jul 24 20:42:38.755775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:38.755272 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:38.755775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:38.755402 2574 patch_prober.go:28] interesting pod/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 24 20:42:38.755775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:38.755445 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 24 20:42:39.754846 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:39.754803 2574 patch_prober.go:28] interesting pod/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 24 20:42:39.755493 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:39.755461 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 24 20:42:40.755147 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:40.755044 2574 patch_prober.go:28] interesting pod/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 24 20:42:40.755701 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:40.755173 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 24 20:42:41.755474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:41.754988 2574 patch_prober.go:28] interesting pod/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 24 20:42:41.755474 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:41.755058 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 24 20:42:42.758911 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:42.758873 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:42.759425 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:42.759201 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:42:42.759985 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:42:42.759967 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:43:03.817002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:03.816958 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:43:03.817606 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:03.817296 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" containerID="cri-o://7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813" gracePeriod=30 Jul 24 20:43:09.063179 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.063150 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:43:09.088813 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088720 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.088813 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088783 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088840 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088869 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088924 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvft5\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088948 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.088976 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089015 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089085 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert\") pod \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\" (UID: \"6d9eb802-ee4d-4824-b2e8-3107a21ed880\") " Jul 24 20:43:09.089396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089065 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:43:09.089396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089174 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:43:09.089396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089373 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.089396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089392 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.089670 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089640 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:43:09.089729 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089701 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:43:09.089849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.089804 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:43:09.091379 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.091353 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:43:09.091478 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.091377 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5" (OuterVolumeSpecName: "kube-api-access-mvft5") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "kube-api-access-mvft5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:43:09.091478 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.091377 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:43:09.091646 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.091621 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d9eb802-ee4d-4824-b2e8-3107a21ed880" (UID: "6d9eb802-ee4d-4824-b2e8-3107a21ed880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:43:09.190042 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190012 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190042 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190038 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190042 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190048 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190056 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190063 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvft5\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-kube-api-access-mvft5\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190086 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d9eb802-ee4d-4824-b2e8-3107a21ed880-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.190301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.190094 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d9eb802-ee4d-4824-b2e8-3107a21ed880-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:09.621554 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.621516 2574 generic.go:356] "Generic (PLEG): container finished" podID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerID="7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813" exitCode=0 Jul 24 20:43:09.621554 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.621558 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" Jul 24 20:43:09.621783 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.621596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerDied","Data":"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813"} Jul 24 20:43:09.621783 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.621649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j" event={"ID":"6d9eb802-ee4d-4824-b2e8-3107a21ed880","Type":"ContainerDied","Data":"2a6da3b3af6a7afaa3321086525cd545fafe5a9c1b2bd2c7452d7f7041dcc47a"} Jul 24 20:43:09.621783 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.621671 2574 scope.go:117] "RemoveContainer" containerID="7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813" Jul 24 20:43:09.631480 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.631456 2574 scope.go:117] "RemoveContainer" containerID="97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244" Jul 24 20:43:09.640906 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.640881 2574 scope.go:117] "RemoveContainer" containerID="7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813" Jul 24 20:43:09.641228 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:43:09.641203 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813\": container with ID starting with 7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813 not found: ID does not exist" containerID="7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813" Jul 24 20:43:09.641268 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.641242 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813"} err="failed to get container status \"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813\": rpc error: code = NotFound desc = could not find container \"7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813\": container with ID starting with 7a5f9da1c20e79667b4f0b7d8b40c440f0bf67dcc50eafeb8106b76db632d813 not found: ID does not exist" Jul 24 20:43:09.641316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.641267 2574 scope.go:117] "RemoveContainer" containerID="97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244" Jul 24 20:43:09.641546 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:43:09.641527 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244\": container with ID starting with 97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244 not found: ID does not exist" containerID="97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244" Jul 24 20:43:09.641595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.641551 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244"} err="failed to get container status \"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244\": rpc error: code = NotFound desc = could not find container \"97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244\": container with ID starting with 97975e84cbe759288807049ad3cfbf7c39be5486b854d97a910b716eb5d54244 not found: ID does not exist" Jul 24 20:43:09.645296 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.645272 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:43:09.649048 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.649023 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8c1aeab3-openshift-default-6cb87f6776-f262j"] Jul 24 20:43:09.714283 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:09.714250 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" path="/var/lib/kubelet/pods/6d9eb802-ee4d-4824-b2e8-3107a21ed880/volumes" Jul 24 20:43:32.603756 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.603717 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq"] Jul 24 20:43:32.604184 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604094 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.604184 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604109 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.604184 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604137 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.604184 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604143 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.604323 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604204 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.604323 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.604211 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d9eb802-ee4d-4824-b2e8-3107a21ed880" containerName="istio-proxy" Jul 24 20:43:32.606365 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.606345 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:32.608961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.608937 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-85rr2\"" Jul 24 20:43:32.609095 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.608991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 20:43:32.614548 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.614369 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq"] Jul 24 20:43:32.705350 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.705307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq\" (UID: \"6972459b-cef5-4723-9e68-47d0ac67e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:32.806259 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.806198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq\" (UID: \"6972459b-cef5-4723-9e68-47d0ac67e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:32.806862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.806842 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq\" (UID: \"6972459b-cef5-4723-9e68-47d0ac67e193\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:32.919026 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:32.918920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:33.057876 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:33.057847 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq"] Jul 24 20:43:33.060013 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:43:33.059982 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6972459b_cef5_4723_9e68_47d0ac67e193.slice/crio-5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7 WatchSource:0}: Error finding container 5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7: Status 404 returned error can't find the container with id 5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7 Jul 24 20:43:33.062541 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:33.062516 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 20:43:33.756219 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:33.756178 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" event={"ID":"6972459b-cef5-4723-9e68-47d0ac67e193","Type":"ContainerStarted","Data":"5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7"} Jul 24 20:43:35.769460 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:35.769424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" event={"ID":"6972459b-cef5-4723-9e68-47d0ac67e193","Type":"ContainerStarted","Data":"3853eaba849b6f09d67bca95483828b252656698b20e9594297366b64583e887"} Jul 24 20:43:35.784104 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:35.784020 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" podStartSLOduration=1.636859926 podStartE2EDuration="3.784002732s" totalImagesPullingTime="2.147142806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:43:35.783840917 +0000 UTC m=+1716.581434043" watchObservedRunningTime="2026-07-24 20:43:35.784002732 +0000 UTC m=+1716.581595838" Jul 24 20:43:36.776974 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:36.776936 2574 generic.go:356] "Generic (PLEG): container finished" podID="6972459b-cef5-4723-9e68-47d0ac67e193" containerID="3853eaba849b6f09d67bca95483828b252656698b20e9594297366b64583e887" exitCode=0 Jul 24 20:43:36.777427 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:36.776998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" event={"ID":"6972459b-cef5-4723-9e68-47d0ac67e193","Type":"ContainerDied","Data":"3853eaba849b6f09d67bca95483828b252656698b20e9594297366b64583e887"} Jul 24 20:43:37.919433 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:37.919407 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:38.057156 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.057025 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca\") pod \"6972459b-cef5-4723-9e68-47d0ac67e193\" (UID: \"6972459b-cef5-4723-9e68-47d0ac67e193\") " Jul 24 20:43:38.057438 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.057410 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6972459b-cef5-4723-9e68-47d0ac67e193" (UID: "6972459b-cef5-4723-9e68-47d0ac67e193"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:43:38.157849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.157814 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6972459b-cef5-4723-9e68-47d0ac67e193-maas-api-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:43:38.789968 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.789937 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" Jul 24 20:43:38.790159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.789972 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq" event={"ID":"6972459b-cef5-4723-9e68-47d0ac67e193","Type":"ContainerDied","Data":"5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7"} Jul 24 20:43:38.790159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:38.790022 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c708723df198c7df04f85df64a30adf0ee7ba765054e0bc4910a5427ccb74c7" Jul 24 20:43:47.674102 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:47.674053 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq"] Jul 24 20:43:47.677163 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:47.677136 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-42b8f369-q52wq"] Jul 24 20:43:47.714191 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:47.714159 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6972459b-cef5-4723-9e68-47d0ac67e193" path="/var/lib/kubelet/pods/6972459b-cef5-4723-9e68-47d0ac67e193/volumes" Jul 24 20:43:48.665470 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.665430 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:43:48.665986 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.665970 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6972459b-cef5-4723-9e68-47d0ac67e193" containerName="revoke-keys" Jul 24 20:43:48.666039 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.665990 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6972459b-cef5-4723-9e68-47d0ac67e193" containerName="revoke-keys" Jul 24 20:43:48.666122 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.666110 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6972459b-cef5-4723-9e68-47d0ac67e193" containerName="revoke-keys" Jul 24 20:43:48.668553 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.668536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.671386 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.671360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bd4a88b3-openshift-default-dockercfg-4nq95\"" Jul 24 20:43:48.678636 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.678604 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:43:48.752099 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjnf7\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752433 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752433 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752433 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752582 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.752582 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.752466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853498 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853498 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.853785 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjnf7\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.853988 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.854029 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.854257 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.854415 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.854385 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.856126 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.856101 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.856471 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.856452 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.862243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.862219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.862355 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.862251 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjnf7\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7\") pod \"e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:48.981335 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:48.981237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:49.132529 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.132500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:43:49.134507 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:43:49.134479 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14ece48_fd7c_4167_980a_310dd3168da8.slice/crio-d7d1df185ca808dc9cd9669d761969ff77c2afaf07872471a4401a012a6f2246 WatchSource:0}: Error finding container d7d1df185ca808dc9cd9669d761969ff77c2afaf07872471a4401a012a6f2246: Status 404 returned error can't find the container with id d7d1df185ca808dc9cd9669d761969ff77c2afaf07872471a4401a012a6f2246 Jul 24 20:43:49.136816 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.136780 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:43:49.136914 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.136872 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:43:49.136978 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.136916 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:43:49.848975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.848929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerStarted","Data":"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68"} Jul 24 20:43:49.849423 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.849000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerStarted","Data":"d7d1df185ca808dc9cd9669d761969ff77c2afaf07872471a4401a012a6f2246"} Jul 24 20:43:49.874482 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.874407 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podStartSLOduration=1.874382938 podStartE2EDuration="1.874382938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:43:49.870698523 +0000 UTC m=+1730.668291650" watchObservedRunningTime="2026-07-24 20:43:49.874382938 +0000 UTC m=+1730.671976043" Jul 24 20:43:49.982134 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:49.982097 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:50.986460 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:50.986431 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:51.860058 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:51.860020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:43:51.861022 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:43:51.860997 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:06.861575 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.861493 2574 patch_prober.go:28] interesting pod/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 24 20:44:06.861575 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.861555 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 24 20:44:06.942301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.942197 2574 generic.go:356] "Generic (PLEG): container finished" podID="e14ece48-fd7c-4167-980a-310dd3168da8" containerID="c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68" exitCode=0 Jul 24 20:44:06.942301 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.942275 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerDied","Data":"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68"} Jul 24 20:44:06.942717 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.942698 2574 scope.go:117] "RemoveContainer" containerID="c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68" Jul 24 20:44:06.943854 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.943792 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:44:06.943909 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.943899 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:44:06.943945 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:06.943934 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:44:07.951681 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:07.951639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerStarted","Data":"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead"} Jul 24 20:44:07.981789 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:07.981740 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:08.982676 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:08.982638 2574 patch_prober.go:28] interesting pod/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 24 20:44:08.983195 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:08.982699 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 24 20:44:09.981699 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:09.981661 2574 patch_prober.go:28] interesting pod/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 24 20:44:09.981885 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:09.981738 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 24 20:44:10.982133 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:10.982062 2574 patch_prober.go:28] interesting pod/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 24 20:44:10.982645 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:10.982179 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 24 20:44:11.981851 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:11.981813 2574 patch_prober.go:28] interesting pod/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 24 20:44:11.982048 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:11.981880 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 24 20:44:12.985833 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:12.985794 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:12.986330 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:12.986207 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:12.986787 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:12.986766 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:33.620239 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:33.620197 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:44:33.620638 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:33.620466 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" containerID="cri-o://b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead" gracePeriod=30 Jul 24 20:44:38.881248 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.881217 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:38.931982 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.931889 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.931982 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.931941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.931985 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932042 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932094 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932121 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932198 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjnf7\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932221 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data\") pod \"e14ece48-fd7c-4167-980a-310dd3168da8\" (UID: \"e14ece48-fd7c-4167-980a-310dd3168da8\") " Jul 24 20:44:38.932595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932314 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:44:38.932595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932391 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:44:38.932595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932581 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:38.932595 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932587 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:44:38.932828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.932599 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:38.933039 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.933003 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:44:38.933256 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.933231 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data" (OuterVolumeSpecName: "istio-data") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:44:38.934430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.934400 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:44:38.934688 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.934656 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:44:38.934872 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.934848 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:44:38.934942 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:38.934861 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7" (OuterVolumeSpecName: "kube-api-access-cjnf7") pod "e14ece48-fd7c-4167-980a-310dd3168da8" (UID: "e14ece48-fd7c-4167-980a-310dd3168da8"). InnerVolumeSpecName "kube-api-access-cjnf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:44:39.033517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033470 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14ece48-fd7c-4167-980a-310dd3168da8-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033509 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033521 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033533 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14ece48-fd7c-4167-980a-310dd3168da8-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033546 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjnf7\" (UniqueName: \"kubernetes.io/projected/e14ece48-fd7c-4167-980a-310dd3168da8-kube-api-access-cjnf7\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033559 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.033772 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.033570 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14ece48-fd7c-4167-980a-310dd3168da8-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:44:39.124165 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.124127 2574 generic.go:356] "Generic (PLEG): container finished" podID="e14ece48-fd7c-4167-980a-310dd3168da8" containerID="b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead" exitCode=0 Jul 24 20:44:39.124370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.124177 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" Jul 24 20:44:39.124370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.124225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerDied","Data":"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead"} Jul 24 20:44:39.124370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.124289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k" event={"ID":"e14ece48-fd7c-4167-980a-310dd3168da8","Type":"ContainerDied","Data":"d7d1df185ca808dc9cd9669d761969ff77c2afaf07872471a4401a012a6f2246"} Jul 24 20:44:39.124370 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.124317 2574 scope.go:117] "RemoveContainer" containerID="b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead" Jul 24 20:44:39.134403 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.134379 2574 scope.go:117] "RemoveContainer" containerID="c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68" Jul 24 20:44:39.143927 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.143903 2574 scope.go:117] "RemoveContainer" containerID="b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead" Jul 24 20:44:39.144342 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:44:39.144315 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead\": container with ID starting with b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead not found: ID does not exist" containerID="b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead" Jul 24 20:44:39.144444 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.144353 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead"} err="failed to get container status \"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead\": rpc error: code = NotFound desc = could not find container \"b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead\": container with ID starting with b4d1462827a3434679365a9535ea22bf764e4bad4c326b5ac9eaf3a49d775ead not found: ID does not exist" Jul 24 20:44:39.144444 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.144371 2574 scope.go:117] "RemoveContainer" containerID="c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68" Jul 24 20:44:39.144653 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:44:39.144636 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68\": container with ID starting with c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68 not found: ID does not exist" containerID="c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68" Jul 24 20:44:39.144710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.144659 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68"} err="failed to get container status \"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68\": rpc error: code = NotFound desc = could not find container \"c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68\": container with ID starting with c121e026dca4d2ae8c0ca311df7ed61c36ba7cfd1d888857a15291860a919f68 not found: ID does not exist" Jul 24 20:44:39.146319 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.146295 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:44:39.149916 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.149892 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bd4a88b3-openshift-default-6b94f9d848-x4q8k"] Jul 24 20:44:39.714681 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:39.714648 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" path="/var/lib/kubelet/pods/e14ece48-fd7c-4167-980a-310dd3168da8/volumes" Jul 24 20:44:59.822412 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:59.822383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:44:59.831778 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:44:59.831746 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:45:00.126228 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126130 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq"] Jul 24 20:45:00.126603 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126586 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.126665 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126605 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.126665 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126613 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.126665 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126619 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.126775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126676 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.126775 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.126686 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14ece48-fd7c-4167-980a-310dd3168da8" containerName="istio-proxy" Jul 24 20:45:00.131271 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.131248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" Jul 24 20:45:00.133934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.133901 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-85rr2\"" Jul 24 20:45:00.136502 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.136467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq"] Jul 24 20:45:00.144402 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.144374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" Jul 24 20:45:00.291877 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:00.291837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq"] Jul 24 20:45:00.294219 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:45:00.294187 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a35aa48_4947_4ffb_b330_041bcb10331b.slice/crio-d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de WatchSource:0}: Error finding container d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de: Status 404 returned error can't find the container with id d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de Jul 24 20:45:01.245694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.245660 2574 generic.go:356] "Generic (PLEG): container finished" podID="5a35aa48-4947-4ffb-b330-041bcb10331b" containerID="f74311c76178e7a3a49055d9855de48063b81d56b6a7dcc4645b2a7b20ec9db0" exitCode=0 Jul 24 20:45:01.246109 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.245700 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" event={"ID":"5a35aa48-4947-4ffb-b330-041bcb10331b","Type":"ContainerDied","Data":"f74311c76178e7a3a49055d9855de48063b81d56b6a7dcc4645b2a7b20ec9db0"} Jul 24 20:45:01.246109 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.245757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" event={"ID":"5a35aa48-4947-4ffb-b330-041bcb10331b","Type":"ContainerStarted","Data":"d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de"} Jul 24 20:45:01.976396 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.976352 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz"] Jul 24 20:45:01.979751 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.979722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:01.982296 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.982271 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 20:45:01.988360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:01.988331 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz"] Jul 24 20:45:02.148372 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.148338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz\" (UID: \"e673a37c-1f36-4424-bcfb-b96dc6e5e721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:02.249018 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.248926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz\" (UID: \"e673a37c-1f36-4424-bcfb-b96dc6e5e721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:02.249674 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.249653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz\" (UID: \"e673a37c-1f36-4424-bcfb-b96dc6e5e721\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:02.292669 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.292629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:02.396994 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.396950 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" Jul 24 20:45:02.449828 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:02.449796 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz"] Jul 24 20:45:02.452348 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:45:02.452319 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode673a37c_1f36_4424_bcfb_b96dc6e5e721.slice/crio-699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511 WatchSource:0}: Error finding container 699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511: Status 404 returned error can't find the container with id 699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511 Jul 24 20:45:03.264806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.264776 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" Jul 24 20:45:03.265228 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.264803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq" event={"ID":"5a35aa48-4947-4ffb-b330-041bcb10331b","Type":"ContainerDied","Data":"d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de"} Jul 24 20:45:03.265228 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.264877 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6280b05a74acb903a0bd8bfcfdfebfb396fe0803ed4411e7ed08be78e26f3de" Jul 24 20:45:03.266451 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.266425 2574 generic.go:356] "Generic (PLEG): container finished" podID="e673a37c-1f36-4424-bcfb-b96dc6e5e721" containerID="f67c027c6f3b2c4a450a0758ffc8264912582a8f09d5eaca22f0dba6d0196721" exitCode=0 Jul 24 20:45:03.266571 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.266501 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" event={"ID":"e673a37c-1f36-4424-bcfb-b96dc6e5e721","Type":"ContainerDied","Data":"f67c027c6f3b2c4a450a0758ffc8264912582a8f09d5eaca22f0dba6d0196721"} Jul 24 20:45:03.266571 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:03.266554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" event={"ID":"e673a37c-1f36-4424-bcfb-b96dc6e5e721","Type":"ContainerStarted","Data":"699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511"} Jul 24 20:45:04.406523 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:04.406491 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:04.571961 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:04.571853 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca\") pod \"e673a37c-1f36-4424-bcfb-b96dc6e5e721\" (UID: \"e673a37c-1f36-4424-bcfb-b96dc6e5e721\") " Jul 24 20:45:04.572342 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:04.572310 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e673a37c-1f36-4424-bcfb-b96dc6e5e721" (UID: "e673a37c-1f36-4424-bcfb-b96dc6e5e721"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:45:04.673050 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:04.672995 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e673a37c-1f36-4424-bcfb-b96dc6e5e721-maas-api-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:45:05.279479 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:05.279450 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" Jul 24 20:45:05.279677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:05.279477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz" event={"ID":"e673a37c-1f36-4424-bcfb-b96dc6e5e721","Type":"ContainerDied","Data":"699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511"} Jul 24 20:45:05.279677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:05.279532 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="699a59045b5fd4c91db0e0460a378c6282998122c80591b5aa144b5ca9dbc511" Jul 24 20:45:12.594179 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:12.594138 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq"] Jul 24 20:45:12.597729 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:12.597693 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-2c1cd65e-29748765-6t5fq"] Jul 24 20:45:13.714438 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:13.714405 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a35aa48-4947-4ffb-b330-041bcb10331b" path="/var/lib/kubelet/pods/5a35aa48-4947-4ffb-b330-041bcb10331b/volumes" Jul 24 20:45:17.117563 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:17.117520 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz"] Jul 24 20:45:17.122116 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:17.122082 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c1cd65e-zgmqz"] Jul 24 20:45:17.714799 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:45:17.714755 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e673a37c-1f36-4424-bcfb-b96dc6e5e721" path="/var/lib/kubelet/pods/e673a37c-1f36-4424-bcfb-b96dc6e5e721/volumes" Jul 24 20:47:10.144454 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144415 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s"] Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144832 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a35aa48-4947-4ffb-b330-041bcb10331b" containerName="cleanup" Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144847 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a35aa48-4947-4ffb-b330-041bcb10331b" containerName="cleanup" Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144857 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e673a37c-1f36-4424-bcfb-b96dc6e5e721" containerName="revoke-keys" Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144863 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e673a37c-1f36-4424-bcfb-b96dc6e5e721" containerName="revoke-keys" Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144928 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a35aa48-4947-4ffb-b330-041bcb10331b" containerName="cleanup" Jul 24 20:47:10.145149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.144937 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e673a37c-1f36-4424-bcfb-b96dc6e5e721" containerName="revoke-keys" Jul 24 20:47:10.148197 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.148175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:10.150837 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.150810 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-85rr2\"" Jul 24 20:47:10.150837 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.150830 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 20:47:10.155508 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.155467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s"] Jul 24 20:47:10.205693 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.205651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s\" (UID: \"f04c40ef-1006-4e6e-96b4-a960e47f30ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:10.306947 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.306899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s\" (UID: \"f04c40ef-1006-4e6e-96b4-a960e47f30ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:10.307666 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.307633 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s\" (UID: \"f04c40ef-1006-4e6e-96b4-a960e47f30ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:10.461132 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.461012 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:10.597173 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:10.597145 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s"] Jul 24 20:47:10.599211 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:47:10.599178 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04c40ef_1006_4e6e_96b4_a960e47f30ac.slice/crio-80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208 WatchSource:0}: Error finding container 80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208: Status 404 returned error can't find the container with id 80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208 Jul 24 20:47:11.003973 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:11.003933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" event={"ID":"f04c40ef-1006-4e6e-96b4-a960e47f30ac","Type":"ContainerStarted","Data":"c3f7bc6bffc8f0a0a5f8c34649cc4d3342c68f8fb74fe9d96592b0e0e01bda4d"} Jul 24 20:47:11.004178 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:11.003989 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" event={"ID":"f04c40ef-1006-4e6e-96b4-a960e47f30ac","Type":"ContainerStarted","Data":"80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208"} Jul 24 20:47:11.020250 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:11.020193 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" podStartSLOduration=1.020178173 podStartE2EDuration="1.020178173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:47:11.018746352 +0000 UTC m=+1931.816339472" watchObservedRunningTime="2026-07-24 20:47:11.020178173 +0000 UTC m=+1931.817771277" Jul 24 20:47:12.010378 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:12.010338 2574 generic.go:356] "Generic (PLEG): container finished" podID="f04c40ef-1006-4e6e-96b4-a960e47f30ac" containerID="c3f7bc6bffc8f0a0a5f8c34649cc4d3342c68f8fb74fe9d96592b0e0e01bda4d" exitCode=0 Jul 24 20:47:12.010796 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:12.010412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" event={"ID":"f04c40ef-1006-4e6e-96b4-a960e47f30ac","Type":"ContainerDied","Data":"c3f7bc6bffc8f0a0a5f8c34649cc4d3342c68f8fb74fe9d96592b0e0e01bda4d"} Jul 24 20:47:13.152320 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:13.152287 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:13.233042 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:13.233003 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca\") pod \"f04c40ef-1006-4e6e-96b4-a960e47f30ac\" (UID: \"f04c40ef-1006-4e6e-96b4-a960e47f30ac\") " Jul 24 20:47:13.233458 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:13.233434 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f04c40ef-1006-4e6e-96b4-a960e47f30ac" (UID: "f04c40ef-1006-4e6e-96b4-a960e47f30ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:47:13.334585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:13.334495 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f04c40ef-1006-4e6e-96b4-a960e47f30ac-maas-api-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:47:14.021842 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:14.021810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" event={"ID":"f04c40ef-1006-4e6e-96b4-a960e47f30ac","Type":"ContainerDied","Data":"80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208"} Jul 24 20:47:14.021842 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:14.021842 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s" Jul 24 20:47:14.022066 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:14.021859 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80fc67d30bf263f13e062d702c52af2b29c58b3ac340530001358799162e4208" Jul 24 20:47:25.219437 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:25.219399 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s"] Jul 24 20:47:25.221637 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:25.221607 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a3b50177-tbr5s"] Jul 24 20:47:25.714604 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:25.714570 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04c40ef-1006-4e6e-96b4-a960e47f30ac" path="/var/lib/kubelet/pods/f04c40ef-1006-4e6e-96b4-a960e47f30ac/volumes" Jul 24 20:47:51.194979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.194049 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:47:51.194979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.194615 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04c40ef-1006-4e6e-96b4-a960e47f30ac" containerName="revoke-keys" Jul 24 20:47:51.194979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.194667 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04c40ef-1006-4e6e-96b4-a960e47f30ac" containerName="revoke-keys" Jul 24 20:47:51.194979 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.194810 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04c40ef-1006-4e6e-96b4-a960e47f30ac" containerName="revoke-keys" Jul 24 20:47:51.198286 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.198235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.201302 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.201268 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-760f3539-openshift-default-dockercfg-686n2\"" Jul 24 20:47:51.210034 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.210002 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:47:51.262417 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmzms\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262639 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.262900 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.262717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364146 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364035 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364146 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmzms\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364146 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364455 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364736 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364736 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.364847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.364752 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.365166 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.365141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.365276 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.365176 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.365403 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.365383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.366615 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.366589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.366907 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.366888 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.372452 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.372423 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.372638 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.372615 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmzms\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms\") pod \"e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.517936 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.517890 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:51.674945 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.674906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:47:51.675875 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:47:51.675840 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af90867_3e7f_44fa_aa1e_b822a998d216.slice/crio-4a75578aece851a6fc0e30ecdc148869f7c17bada21d3af6c0f37316f741bb63 WatchSource:0}: Error finding container 4a75578aece851a6fc0e30ecdc148869f7c17bada21d3af6c0f37316f741bb63: Status 404 returned error can't find the container with id 4a75578aece851a6fc0e30ecdc148869f7c17bada21d3af6c0f37316f741bb63 Jul 24 20:47:51.678353 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.678300 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:47:51.678445 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.678401 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:47:51.678485 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:51.678443 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:47:52.232148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:52.232113 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerStarted","Data":"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600"} Jul 24 20:47:52.232666 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:52.232172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerStarted","Data":"4a75578aece851a6fc0e30ecdc148869f7c17bada21d3af6c0f37316f741bb63"} Jul 24 20:47:52.252618 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:52.252560 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podStartSLOduration=1.252543811 podStartE2EDuration="1.252543811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:47:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:47:52.250524813 +0000 UTC m=+1973.048117918" watchObservedRunningTime="2026-07-24 20:47:52.252543811 +0000 UTC m=+1973.050136916" Jul 24 20:47:52.518449 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:52.518411 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:52.523360 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:52.523329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:53.238643 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:53.238607 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:47:53.239690 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:47:53.239663 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:48:08.239734 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.239695 2574 patch_prober.go:28] interesting pod/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 20:48:08.240223 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.239770 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 20:48:08.326585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.326483 2574 generic.go:356] "Generic (PLEG): container finished" podID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerID="9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600" exitCode=0 Jul 24 20:48:08.326585 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.326540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerDied","Data":"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600"} Jul 24 20:48:08.327002 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.326985 2574 scope.go:117] "RemoveContainer" containerID="9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600" Jul 24 20:48:08.328120 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.328089 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:48:08.328221 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.328187 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:48:08.328292 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:08.328247 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:48:09.337123 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:09.337054 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerStarted","Data":"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a"} Jul 24 20:48:09.518699 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:09.518661 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:48:09.518896 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:09.518871 2574 patch_prober.go:28] interesting pod/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 20:48:09.518946 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:09.518925 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 20:48:10.518618 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:10.518577 2574 patch_prober.go:28] interesting pod/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 20:48:10.519057 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:10.518669 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 20:48:11.519344 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:11.519301 2574 patch_prober.go:28] interesting pod/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 20:48:11.519766 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:11.519378 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 20:48:12.518841 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:12.518800 2574 patch_prober.go:28] interesting pod/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 20:48:12.519035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:12.518863 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 20:48:13.522769 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:13.522733 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:48:13.523268 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:13.523024 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:48:13.523938 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:48:13.523922 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:49:45.452428 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:45.452392 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:49:45.452976 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:45.452700 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" containerID="cri-o://cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a" gracePeriod=30 Jul 24 20:49:50.715680 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.715597 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:49:50.777090 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777038 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777105 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777122 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777165 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777194 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777221 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777282 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmzms\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777314 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.777542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777428 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:49:50.777542 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777492 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:49:50.777755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777591 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.777755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777632 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.777755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777664 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:49:50.777755 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.777686 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:49:50.778123 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.778095 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data" (OuterVolumeSpecName: "istio-data") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:49:50.779694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.779658 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:49:50.779694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.779661 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:49:50.779847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.779740 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms" (OuterVolumeSpecName: "kube-api-access-vmzms") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "kube-api-access-vmzms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:49:50.878760 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878715 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token\") pod \"0af90867-3e7f-44fa-aa1e-b822a998d216\" (UID: \"0af90867-3e7f-44fa-aa1e-b822a998d216\") " Jul 24 20:49:50.878975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878945 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af90867-3e7f-44fa-aa1e-b822a998d216-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.878975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878958 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.878975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878966 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.878975 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878975 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmzms\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-kube-api-access-vmzms\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.879243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878985 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.879243 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.878993 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:50.880970 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.880940 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token" (OuterVolumeSpecName: "istio-token") pod "0af90867-3e7f-44fa-aa1e-b822a998d216" (UID: "0af90867-3e7f-44fa-aa1e-b822a998d216"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:49:50.915260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.915223 2574 generic.go:356] "Generic (PLEG): container finished" podID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerID="cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a" exitCode=0 Jul 24 20:49:50.915436 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.915271 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" Jul 24 20:49:50.915436 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.915306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerDied","Data":"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a"} Jul 24 20:49:50.915436 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.915368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq" event={"ID":"0af90867-3e7f-44fa-aa1e-b822a998d216","Type":"ContainerDied","Data":"4a75578aece851a6fc0e30ecdc148869f7c17bada21d3af6c0f37316f741bb63"} Jul 24 20:49:50.915436 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.915391 2574 scope.go:117] "RemoveContainer" containerID="cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a" Jul 24 20:49:50.925171 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.925150 2574 scope.go:117] "RemoveContainer" containerID="9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600" Jul 24 20:49:50.935284 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.935260 2574 scope.go:117] "RemoveContainer" containerID="cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a" Jul 24 20:49:50.935684 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:49:50.935659 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a\": container with ID starting with cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a not found: ID does not exist" containerID="cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a" Jul 24 20:49:50.935810 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.935690 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a"} err="failed to get container status \"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a\": rpc error: code = NotFound desc = could not find container \"cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a\": container with ID starting with cc7e6a38569825bb0d0b1aed6d8babc293317b29e577c1a06c0b5a16d0122d0a not found: ID does not exist" Jul 24 20:49:50.935810 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.935710 2574 scope.go:117] "RemoveContainer" containerID="9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600" Jul 24 20:49:50.935997 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:49:50.935975 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600\": container with ID starting with 9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600 not found: ID does not exist" containerID="9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600" Jul 24 20:49:50.936058 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.936002 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600"} err="failed to get container status \"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600\": rpc error: code = NotFound desc = could not find container \"9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600\": container with ID starting with 9bcf783481bddc877cb36d2e467ff911ba9f7f212586f758c25d34475a0fb600 not found: ID does not exist" Jul 24 20:49:50.937811 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.937781 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:49:50.941394 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.941366 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-760f3539-openshift-default-7f7b59b8d4-8tpcq"] Jul 24 20:49:50.979719 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:50.979629 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af90867-3e7f-44fa-aa1e-b822a998d216-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:49:51.715024 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:51.714981 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" path="/var/lib/kubelet/pods/0af90867-3e7f-44fa-aa1e-b822a998d216/volumes" Jul 24 20:49:59.865694 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:59.865663 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:49:59.870024 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:59.869996 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:49:59.938913 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:49:59.938880 2574 scope.go:117] "RemoveContainer" containerID="3853eaba849b6f09d67bca95483828b252656698b20e9594297366b64583e887" Jul 24 20:50:50.366018 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.365965 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:50:50.366657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.366533 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:50:50.366657 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.366555 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:50:50.366770 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.366676 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:50:50.370469 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.370436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.373220 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.373191 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-55d9b1-openshift-default-dockercfg-7k6g9\"" Jul 24 20:50:50.379920 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.379883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:50:50.427279 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427707 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8vz\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427707 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427707 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.427707 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.427665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528619 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.528836 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.528968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8vz\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529260 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529422 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529268 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529488 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529611 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529572 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.529766 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.529743 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.531246 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.531223 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.531461 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.531438 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.539295 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.539264 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.539845 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.539821 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8vz\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz\") pod \"e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.685388 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.685284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:50.838687 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.838657 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:50:50.840872 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:50:50.840842 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26aaa107_a4b7_498a_892e_4c15e5778417.slice/crio-6ce0d93216a061c341fa1876fb1e4b76cbdb302c3c0772a082b9a90d50d069d4 WatchSource:0}: Error finding container 6ce0d93216a061c341fa1876fb1e4b76cbdb302c3c0772a082b9a90d50d069d4: Status 404 returned error can't find the container with id 6ce0d93216a061c341fa1876fb1e4b76cbdb302c3c0772a082b9a90d50d069d4 Jul 24 20:50:50.843043 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.843010 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:50:50.843151 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.843118 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:50:50.843194 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:50.843150 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:50:51.249131 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:51.249095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerStarted","Data":"7197f81a7f4336b4450016cffb9cccea339ea0a3cd580e2259399be6401e85bb"} Jul 24 20:50:51.249321 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:51.249157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerStarted","Data":"6ce0d93216a061c341fa1876fb1e4b76cbdb302c3c0772a082b9a90d50d069d4"} Jul 24 20:50:51.270576 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:51.270518 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podStartSLOduration=1.270500919 podStartE2EDuration="1.270500919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:50:51.26955142 +0000 UTC m=+2152.067144553" watchObservedRunningTime="2026-07-24 20:50:51.270500919 +0000 UTC m=+2152.068094024" Jul 24 20:50:51.686450 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:51.686406 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:51.691614 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:51.691586 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:52.255332 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:52.255296 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:50:52.256456 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:50:52.256431 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:06.345856 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.345815 2574 generic.go:356] "Generic (PLEG): container finished" podID="26aaa107-a4b7-498a-892e-4c15e5778417" containerID="7197f81a7f4336b4450016cffb9cccea339ea0a3cd580e2259399be6401e85bb" exitCode=0 Jul 24 20:51:06.346343 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.345890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerDied","Data":"7197f81a7f4336b4450016cffb9cccea339ea0a3cd580e2259399be6401e85bb"} Jul 24 20:51:06.346388 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.346352 2574 scope.go:117] "RemoveContainer" containerID="7197f81a7f4336b4450016cffb9cccea339ea0a3cd580e2259399be6401e85bb" Jul 24 20:51:06.347644 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.347606 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:51:06.347765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.347685 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:51:06.347765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:06.347718 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:51:07.255607 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:07.255567 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:07.358812 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:07.358768 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerStarted","Data":"f4c754b53ca39f2367a82cff2447b28f746b2dbc7b755e1359a82e1bdf650b25"} Jul 24 20:51:07.686160 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:07.686117 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:07.687549 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:07.687516 2574 patch_prober.go:28] interesting pod/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 24 20:51:07.687718 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:07.687583 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 24 20:51:08.686358 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:08.686311 2574 patch_prober.go:28] interesting pod/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 24 20:51:08.686806 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:08.686382 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 24 20:51:09.686656 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:09.686619 2574 patch_prober.go:28] interesting pod/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 24 20:51:09.687118 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:09.686710 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 24 20:51:10.685684 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:10.685647 2574 patch_prober.go:28] interesting pod/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 24 20:51:10.685889 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:10.685710 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 24 20:51:11.690169 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:11.690132 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:11.690611 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:11.690442 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:11.691362 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:11.691344 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:51:59.973777 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:59.973740 2574 scope.go:117] "RemoveContainer" containerID="f74311c76178e7a3a49055d9855de48063b81d56b6a7dcc4645b2a7b20ec9db0" Jul 24 20:51:59.982847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:51:59.982825 2574 scope.go:117] "RemoveContainer" containerID="f67c027c6f3b2c4a450a0758ffc8264912582a8f09d5eaca22f0dba6d0196721" Jul 24 20:52:08.307093 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.307033 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x"] Jul 24 20:52:08.307601 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.307569 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:52:08.307601 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.307588 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:52:08.307685 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.307661 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af90867-3e7f-44fa-aa1e-b822a998d216" containerName="istio-proxy" Jul 24 20:52:08.310818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.310793 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:08.314065 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.314030 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-85rr2\"" Jul 24 20:52:08.314289 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.314044 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 20:52:08.318430 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.318395 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x"] Jul 24 20:52:08.370668 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.370625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x\" (UID: \"a62720c6-c8e9-43bf-920b-8126ea90c6ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:08.471864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.471827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x\" (UID: \"a62720c6-c8e9-43bf-920b-8126ea90c6ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:08.472536 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.472513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x\" (UID: \"a62720c6-c8e9-43bf-920b-8126ea90c6ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:08.624384 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.624290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:08.768310 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:08.768279 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x"] Jul 24 20:52:08.770553 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:52:08.770519 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62720c6_c8e9_43bf_920b_8126ea90c6ab.slice/crio-2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f WatchSource:0}: Error finding container 2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f: Status 404 returned error can't find the container with id 2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f Jul 24 20:52:09.703334 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:09.703236 2574 generic.go:356] "Generic (PLEG): container finished" podID="a62720c6-c8e9-43bf-920b-8126ea90c6ab" containerID="17950123a232c8c31f66c52f77397d71ade87b7c9db34b087452631fb6f0e216" exitCode=0 Jul 24 20:52:09.703765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:09.703331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" event={"ID":"a62720c6-c8e9-43bf-920b-8126ea90c6ab","Type":"ContainerDied","Data":"17950123a232c8c31f66c52f77397d71ade87b7c9db34b087452631fb6f0e216"} Jul 24 20:52:09.703765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:09.703434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" event={"ID":"a62720c6-c8e9-43bf-920b-8126ea90c6ab","Type":"ContainerStarted","Data":"2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f"} Jul 24 20:52:10.849447 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:10.849414 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:10.894191 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:10.894156 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca\") pod \"a62720c6-c8e9-43bf-920b-8126ea90c6ab\" (UID: \"a62720c6-c8e9-43bf-920b-8126ea90c6ab\") " Jul 24 20:52:10.894544 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:10.894518 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a62720c6-c8e9-43bf-920b-8126ea90c6ab" (UID: "a62720c6-c8e9-43bf-920b-8126ea90c6ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:52:10.995746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:10.995647 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62720c6-c8e9-43bf-920b-8126ea90c6ab-maas-api-service-ca\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:11.716670 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:11.716637 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" Jul 24 20:52:11.716864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:11.716671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x" event={"ID":"a62720c6-c8e9-43bf-920b-8126ea90c6ab","Type":"ContainerDied","Data":"2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f"} Jul 24 20:52:11.716864 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:11.716725 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ae68f681f9ff338ec135256a50bfa5c77618f8d664bdc45b582651b0dbab64f" Jul 24 20:52:23.384725 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:23.384501 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x"] Jul 24 20:52:23.387180 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:23.387151 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c97e06-zjs7x"] Jul 24 20:52:23.714517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:23.714435 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62720c6-c8e9-43bf-920b-8126ea90c6ab" path="/var/lib/kubelet/pods/a62720c6-c8e9-43bf-920b-8126ea90c6ab/volumes" Jul 24 20:52:51.816612 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:51.816570 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:52:51.817146 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:51.816855 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" containerID="cri-o://f4c754b53ca39f2367a82cff2447b28f746b2dbc7b755e1359a82e1bdf650b25" gracePeriod=30 Jul 24 20:52:56.694182 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:56.694134 2574 patch_prober.go:28] interesting pod/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 20:52:56.694759 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:56.694328 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 20:52:56.975211 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:56.975114 2574 generic.go:356] "Generic (PLEG): container finished" podID="26aaa107-a4b7-498a-892e-4c15e5778417" containerID="f4c754b53ca39f2367a82cff2447b28f746b2dbc7b755e1359a82e1bdf650b25" exitCode=0 Jul 24 20:52:56.975356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:56.975197 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerDied","Data":"f4c754b53ca39f2367a82cff2447b28f746b2dbc7b755e1359a82e1bdf650b25"} Jul 24 20:52:56.975356 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:56.975305 2574 scope.go:117] "RemoveContainer" containerID="7197f81a7f4336b4450016cffb9cccea339ea0a3cd580e2259399be6401e85bb" Jul 24 20:52:57.078898 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.078861 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:52:57.117270 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117236 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117285 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117303 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117324 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117343 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117368 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn8vz\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117406 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117465 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117440 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117474 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data\") pod \"26aaa107-a4b7-498a-892e-4c15e5778417\" (UID: \"26aaa107-a4b7-498a-892e-4c15e5778417\") " Jul 24 20:52:57.117849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117560 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:52:57.117849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117778 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:52:57.117849 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117806 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.118062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117990 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:52:57.118062 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.117999 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:52:57.118662 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.118629 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data" (OuterVolumeSpecName: "istio-data") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:52:57.119702 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.119673 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token" (OuterVolumeSpecName: "istio-token") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:52:57.119866 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.119847 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:52:57.119941 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.119918 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:52:57.120230 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.120206 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz" (OuterVolumeSpecName: "kube-api-access-wn8vz") pod "26aaa107-a4b7-498a-892e-4c15e5778417" (UID: "26aaa107-a4b7-498a-892e-4c15e5778417"). InnerVolumeSpecName "kube-api-access-wn8vz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:52:57.218744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218703 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn8vz\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-kube-api-access-wn8vz\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.218744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218739 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26aaa107-a4b7-498a-892e-4c15e5778417-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.218744 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218748 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.219004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218760 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.219004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218769 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26aaa107-a4b7-498a-892e-4c15e5778417-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.219004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218777 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.219004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218785 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26aaa107-a4b7-498a-892e-4c15e5778417-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.219004 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.218793 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26aaa107-a4b7-498a-892e-4c15e5778417-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:52:57.981934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.981841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" event={"ID":"26aaa107-a4b7-498a-892e-4c15e5778417","Type":"ContainerDied","Data":"6ce0d93216a061c341fa1876fb1e4b76cbdb302c3c0772a082b9a90d50d069d4"} Jul 24 20:52:57.981934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.981868 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c" Jul 24 20:52:57.981934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:57.981922 2574 scope.go:117] "RemoveContainer" containerID="f4c754b53ca39f2367a82cff2447b28f746b2dbc7b755e1359a82e1bdf650b25" Jul 24 20:52:58.001607 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:58.001568 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:52:58.005915 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:58.005870 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-55d9b1-openshift-default-6944f8dc5b-kxg7c"] Jul 24 20:52:59.714032 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:52:59.714000 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" path="/var/lib/kubelet/pods/26aaa107-a4b7-498a-892e-4c15e5778417/volumes" Jul 24 20:53:01.225122 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225062 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:53:01.225607 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225592 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62720c6-c8e9-43bf-920b-8126ea90c6ab" containerName="revoke-keys" Jul 24 20:53:01.225661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225611 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62720c6-c8e9-43bf-920b-8126ea90c6ab" containerName="revoke-keys" Jul 24 20:53:01.225661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225638 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.225661 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225647 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.225765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225665 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.225765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225675 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.225765 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225753 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62720c6-c8e9-43bf-920b-8126ea90c6ab" containerName="revoke-keys" Jul 24 20:53:01.225855 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225770 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.225855 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.225780 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26aaa107-a4b7-498a-892e-4c15e5778417" containerName="istio-proxy" Jul 24 20:53:01.230963 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.230932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.233511 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.233483 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1ae1a9-openshift-default-dockercfg-8x288\"" Jul 24 20:53:01.238026 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.237995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:53:01.253749 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njd56\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.253934 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.253918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.254247 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.254026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.254247 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.254063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.354840 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354879 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.354998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njd56\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355049 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355389 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355504 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355504 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355597 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355649 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355626 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.355839 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.355815 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.357770 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.357745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.357873 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.357847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.362733 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.362698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.362855 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.362776 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njd56\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56\") pod \"e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.546758 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.546717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:01.703267 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.703233 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:53:01.705266 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:53:01.705238 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fffc15_6a5d_43e7_b0fa_af6b6a440f07.slice/crio-8015d451b2c0559ea0e3b36a2279d322d1e2667a9b7590f585dfa3a4f01ceff0 WatchSource:0}: Error finding container 8015d451b2c0559ea0e3b36a2279d322d1e2667a9b7590f585dfa3a4f01ceff0: Status 404 returned error can't find the container with id 8015d451b2c0559ea0e3b36a2279d322d1e2667a9b7590f585dfa3a4f01ceff0 Jul 24 20:53:01.707983 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.707938 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:01.708105 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.708029 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:01.708163 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:01.708104 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:02.009284 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:02.009242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerStarted","Data":"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7"} Jul 24 20:53:02.009478 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:02.009308 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerStarted","Data":"8015d451b2c0559ea0e3b36a2279d322d1e2667a9b7590f585dfa3a4f01ceff0"} Jul 24 20:53:02.030562 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:02.030507 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podStartSLOduration=1.030491292 podStartE2EDuration="1.030491292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:53:02.028739174 +0000 UTC m=+2282.826332273" watchObservedRunningTime="2026-07-24 20:53:02.030491292 +0000 UTC m=+2282.828084396" Jul 24 20:53:02.547820 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:02.547777 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:02.552658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:02.552629 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:03.015101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:03.015060 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:03.016102 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:03.016056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:22.120429 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.120392 2574 generic.go:356] "Generic (PLEG): container finished" podID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerID="778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7" exitCode=0 Jul 24 20:53:22.120995 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.120466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerDied","Data":"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7"} Jul 24 20:53:22.121065 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.121025 2574 scope.go:117] "RemoveContainer" containerID="778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7" Jul 24 20:53:22.122123 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.122092 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:22.122187 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.122168 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:22.122224 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:22.122200 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:53:23.128280 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:23.128244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerStarted","Data":"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44"} Jul 24 20:53:23.547720 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:23.547620 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:23.548109 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:23.548054 2574 patch_prober.go:28] interesting pod/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 24 20:53:23.548299 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:23.548274 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 24 20:53:24.547325 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:24.547274 2574 patch_prober.go:28] interesting pod/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 24 20:53:24.547878 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:24.547353 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 24 20:53:25.547697 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:25.547651 2574 patch_prober.go:28] interesting pod/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 24 20:53:25.548377 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:25.548340 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 24 20:53:26.548148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:26.547661 2574 patch_prober.go:28] interesting pod/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 24 20:53:26.548148 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:26.547729 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 24 20:53:27.551659 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:27.551627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:27.552064 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:27.551982 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:53:27.552695 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:53:27.552677 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:54:00.024847 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:00.024765 2574 scope.go:117] "RemoveContainer" containerID="c3f7bc6bffc8f0a0a5f8c34649cc4d3342c68f8fb74fe9d96592b0e0e01bda4d" Jul 24 20:54:09.730655 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:09.730618 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:54:09.731114 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:09.730912 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" containerID="cri-o://c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44" gracePeriod=30 Jul 24 20:54:12.554644 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:12.554598 2574 patch_prober.go:28] interesting pod/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 20:54:12.555061 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:12.554672 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 20:54:15.000466 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.000384 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:54:15.127101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127038 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127101 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127105 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127138 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127185 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127214 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127260 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njd56\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127283 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127325 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127373 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127363 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket\") pod \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\" (UID: \"09fffc15-6a5d-43e7-b0fa-af6b6a440f07\") " Jul 24 20:54:15.127723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127412 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:54:15.127723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127644 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:54:15.127723 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127702 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.127884 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127844 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 20:54:15.127884 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.127862 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:54:15.128420 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.128396 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data" (OuterVolumeSpecName: "istio-data") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:54:15.129573 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.129542 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 20:54:15.129573 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.129565 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token" (OuterVolumeSpecName: "istio-token") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:54:15.129848 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.129824 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 20:54:15.129939 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.129842 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56" (OuterVolumeSpecName: "kube-api-access-njd56") pod "09fffc15-6a5d-43e7-b0fa-af6b6a440f07" (UID: "09fffc15-6a5d-43e7-b0fa-af6b6a440f07"). InnerVolumeSpecName "kube-api-access-njd56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 20:54:15.228862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228820 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.228862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228852 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.228862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228863 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.228862 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228872 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.229170 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228882 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njd56\" (UniqueName: \"kubernetes.io/projected/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-kube-api-access-njd56\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.229170 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228892 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.229170 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228900 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.229170 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.228910 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09fffc15-6a5d-43e7-b0fa-af6b6a440f07-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 20:54:15.430814 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.430780 2574 generic.go:356] "Generic (PLEG): container finished" podID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerID="c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44" exitCode=0 Jul 24 20:54:15.431007 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.430831 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" Jul 24 20:54:15.431007 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.430852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerDied","Data":"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44"} Jul 24 20:54:15.431007 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.430897 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw" event={"ID":"09fffc15-6a5d-43e7-b0fa-af6b6a440f07","Type":"ContainerDied","Data":"8015d451b2c0559ea0e3b36a2279d322d1e2667a9b7590f585dfa3a4f01ceff0"} Jul 24 20:54:15.431007 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.430917 2574 scope.go:117] "RemoveContainer" containerID="c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44" Jul 24 20:54:15.443770 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.443740 2574 scope.go:117] "RemoveContainer" containerID="778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7" Jul 24 20:54:15.456159 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.456135 2574 scope.go:117] "RemoveContainer" containerID="c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44" Jul 24 20:54:15.456515 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:54:15.456491 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44\": container with ID starting with c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44 not found: ID does not exist" containerID="c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44" Jul 24 20:54:15.456588 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.456524 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44"} err="failed to get container status \"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44\": rpc error: code = NotFound desc = could not find container \"c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44\": container with ID starting with c25b852b6503478cf1e0568e20d0e5585d0850a38e5335820115a5911722ba44 not found: ID does not exist" Jul 24 20:54:15.456588 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.456545 2574 scope.go:117] "RemoveContainer" containerID="778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7" Jul 24 20:54:15.456868 ip-10-0-132-198 kubenswrapper[2574]: E0724 20:54:15.456851 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7\": container with ID starting with 778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7 not found: ID does not exist" containerID="778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7" Jul 24 20:54:15.456952 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.456871 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7"} err="failed to get container status \"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7\": rpc error: code = NotFound desc = could not find container \"778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7\": container with ID starting with 778ca0193f86272c243c1bba7e9715fa116fe9d1b791f4d160331ddb07fa25d7 not found: ID does not exist" Jul 24 20:54:15.463548 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.463511 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:54:15.468023 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.467990 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1ae1a9-openshift-default-8499f77dfd-b4tqw"] Jul 24 20:54:15.715047 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:15.714958 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" path="/var/lib/kubelet/pods/09fffc15-6a5d-43e7-b0fa-af6b6a440f07/volumes" Jul 24 20:54:18.476658 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.476603 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 20:54:18.477207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477147 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.477207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477163 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.477207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477199 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.477207 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477208 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.477464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477296 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.477464 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.477306 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="09fffc15-6a5d-43e7-b0fa-af6b6a440f07" containerName="istio-proxy" Jul 24 20:54:18.482106 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.482059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.484589 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.484566 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-449ecf-openshift-default-dockercfg-dzkmx\"" Jul 24 20:54:18.491870 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.491839 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 20:54:18.557787 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.557990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.557990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.557990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.557990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcm9q\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.557990 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.557990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.558252 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.558008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.558252 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.558030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.558252 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.558144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659527 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcm9q\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.659746 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660035 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.659976 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660276 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.660256 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660358 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.660335 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660491 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.660462 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.660606 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.660586 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.662122 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.662095 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.662453 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.662435 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.667701 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.667670 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcm9q\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.667832 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.667807 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token\") pod \"e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.795175 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.795132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:18.941855 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.941826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 20:54:18.944581 ip-10-0-132-198 kubenswrapper[2574]: W0724 20:54:18.944553 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d2b27c_6053_4f47_a104_19162369d117.slice/crio-7dd27003f0e12d6f8cafd2a4c29b7633c36f802afe1e5ab51e0ce4557a41cb94 WatchSource:0}: Error finding container 7dd27003f0e12d6f8cafd2a4c29b7633c36f802afe1e5ab51e0ce4557a41cb94: Status 404 returned error can't find the container with id 7dd27003f0e12d6f8cafd2a4c29b7633c36f802afe1e5ab51e0ce4557a41cb94 Jul 24 20:54:18.946724 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.946690 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:18.946818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.946759 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:18.946818 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:18.946786 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:19.454677 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:19.454637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerStarted","Data":"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae"} Jul 24 20:54:19.454843 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:19.454709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerStarted","Data":"7dd27003f0e12d6f8cafd2a4c29b7633c36f802afe1e5ab51e0ce4557a41cb94"} Jul 24 20:54:19.475439 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:19.475385 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podStartSLOduration=1.475368392 podStartE2EDuration="1.475368392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 20:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 20:54:19.474169694 +0000 UTC m=+2360.271762831" watchObservedRunningTime="2026-07-24 20:54:19.475368392 +0000 UTC m=+2360.272961543" Jul 24 20:54:19.795710 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:19.795672 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:20.801183 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:20.801152 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:21.476825 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:21.476795 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:21.477805 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:21.477781 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:36.478517 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.478473 2574 patch_prober.go:28] interesting pod/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 24 20:54:36.479009 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.478555 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 24 20:54:36.564766 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.564732 2574 generic.go:356] "Generic (PLEG): container finished" podID="19d2b27c-6053-4f47-a104-19162369d117" containerID="51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae" exitCode=0 Jul 24 20:54:36.564766 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.564776 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerDied","Data":"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae"} Jul 24 20:54:36.565179 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.565165 2574 scope.go:117] "RemoveContainer" containerID="51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae" Jul 24 20:54:36.566249 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.566218 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:36.566332 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.566296 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:36.566369 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:36.566348 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 20:54:37.571761 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:37.571726 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerStarted","Data":"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1"} Jul 24 20:54:37.795859 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:37.795813 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:37.796055 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:37.796029 2574 patch_prober.go:28] interesting pod/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 24 20:54:37.796149 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:37.796107 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 24 20:54:38.795781 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:38.795742 2574 patch_prober.go:28] interesting pod/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 24 20:54:38.796251 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:38.795804 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 24 20:54:39.795673 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:39.795630 2574 patch_prober.go:28] interesting pod/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 24 20:54:39.795887 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:39.795698 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 24 20:54:40.795832 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:40.795788 2574 patch_prober.go:28] interesting pod/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 24 20:54:40.796039 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:40.795863 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 24 20:54:41.799917 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:41.799886 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:41.800419 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:41.800179 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:41.801010 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:41.800991 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 20:54:59.901105 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:59.901060 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:54:59.906669 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:54:59.906643 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:59:00.088316 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:59:00.088282 2574 scope.go:117] "RemoveContainer" containerID="17950123a232c8c31f66c52f77397d71ade87b7c9db34b087452631fb6f0e216" Jul 24 20:59:59.936834 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:59:59.936745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 20:59:59.943954 ip-10-0-132-198 kubenswrapper[2574]: I0724 20:59:59.943924 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 21:02:34.007670 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.007631 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-139855873127472"] Jul 24 21:02:34.011627 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.011578 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:34.014332 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.014301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5zkhj\"" Jul 24 21:02:34.014879 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.014851 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855873127472"] Jul 24 21:02:34.139051 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.139007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8c6\" (UniqueName: \"kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6\") pod \"test-curl-7742-139855873127472\" (UID: \"4fa957c3-2c90-40ca-b61e-0fcd005c9682\") " pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:34.239656 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.239609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8c6\" (UniqueName: \"kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6\") pod \"test-curl-7742-139855873127472\" (UID: \"4fa957c3-2c90-40ca-b61e-0fcd005c9682\") " pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:34.247712 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.247681 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8c6\" (UniqueName: \"kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6\") pod \"test-curl-7742-139855873127472\" (UID: \"4fa957c3-2c90-40ca-b61e-0fcd005c9682\") " pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:34.322636 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.322541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:34.478911 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.478879 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855873127472"] Jul 24 21:02:34.481432 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:02:34.481401 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fa957c3_2c90_40ca_b61e_0fcd005c9682.slice/crio-2c00da5f75a589f3e92bf88cdf39be92b659ce26de18595c63c61074f08d762d WatchSource:0}: Error finding container 2c00da5f75a589f3e92bf88cdf39be92b659ce26de18595c63c61074f08d762d: Status 404 returned error can't find the container with id 2c00da5f75a589f3e92bf88cdf39be92b659ce26de18595c63c61074f08d762d Jul 24 21:02:34.482748 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:34.482730 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 21:02:35.200801 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:35.200763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855873127472" event={"ID":"4fa957c3-2c90-40ca-b61e-0fcd005c9682","Type":"ContainerStarted","Data":"2c00da5f75a589f3e92bf88cdf39be92b659ce26de18595c63c61074f08d762d"} Jul 24 21:02:36.207299 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:36.207258 2574 generic.go:356] "Generic (PLEG): container finished" podID="4fa957c3-2c90-40ca-b61e-0fcd005c9682" containerID="cfd6846c642156486de19b03c8deb9f559d754e7fb3c917f2920898e8a7b4ed7" exitCode=0 Jul 24 21:02:36.207709 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:36.207345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855873127472" event={"ID":"4fa957c3-2c90-40ca-b61e-0fcd005c9682","Type":"ContainerDied","Data":"cfd6846c642156486de19b03c8deb9f559d754e7fb3c917f2920898e8a7b4ed7"} Jul 24 21:02:37.365885 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.365851 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:37.373374 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.373344 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b8c6\" (UniqueName: \"kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6\") pod \"4fa957c3-2c90-40ca-b61e-0fcd005c9682\" (UID: \"4fa957c3-2c90-40ca-b61e-0fcd005c9682\") " Jul 24 21:02:37.375664 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.375625 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6" (OuterVolumeSpecName: "kube-api-access-7b8c6") pod "4fa957c3-2c90-40ca-b61e-0fcd005c9682" (UID: "4fa957c3-2c90-40ca-b61e-0fcd005c9682"). InnerVolumeSpecName "kube-api-access-7b8c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:02:37.399367 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.399325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-139855873127472_4fa957c3-2c90-40ca-b61e-0fcd005c9682/test-curl-7742-139855873127472/0.log" Jul 24 21:02:37.422901 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.422859 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-139855873127472"] Jul 24 21:02:37.426731 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.426697 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-139855873127472"] Jul 24 21:02:37.474362 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.474261 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b8c6\" (UniqueName: \"kubernetes.io/projected/4fa957c3-2c90-40ca-b61e-0fcd005c9682-kube-api-access-7b8c6\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:02:37.544497 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.544455 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-139855873111856"] Jul 24 21:02:37.544874 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.544858 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa957c3-2c90-40ca-b61e-0fcd005c9682" containerName="test-curl-7742-139855873127472" Jul 24 21:02:37.544923 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.544875 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa957c3-2c90-40ca-b61e-0fcd005c9682" containerName="test-curl-7742-139855873127472" Jul 24 21:02:37.544975 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.544964 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa957c3-2c90-40ca-b61e-0fcd005c9682" containerName="test-curl-7742-139855873127472" Jul 24 21:02:37.547955 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.547933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:37.554951 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.554921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855873111856"] Jul 24 21:02:37.574833 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.574796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8ws\" (UniqueName: \"kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws\") pod \"test-curl-7742-139855873111856\" (UID: \"e2465802-dc81-4d47-b5bb-d1930830834b\") " pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:37.675954 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.675908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8ws\" (UniqueName: \"kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws\") pod \"test-curl-7742-139855873111856\" (UID: \"e2465802-dc81-4d47-b5bb-d1930830834b\") " pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:37.685091 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.685036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8ws\" (UniqueName: \"kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws\") pod \"test-curl-7742-139855873111856\" (UID: \"e2465802-dc81-4d47-b5bb-d1930830834b\") " pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:37.715816 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.715777 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa957c3-2c90-40ca-b61e-0fcd005c9682" path="/var/lib/kubelet/pods/4fa957c3-2c90-40ca-b61e-0fcd005c9682/volumes" Jul 24 21:02:37.859929 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:37.859891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:38.006696 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:02:38.006656 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2465802_dc81_4d47_b5bb_d1930830834b.slice/crio-450e3a3791917211586a4afe15a4c1ff055d72c82aec6083bd845d78fe44b69f WatchSource:0}: Error finding container 450e3a3791917211586a4afe15a4c1ff055d72c82aec6083bd845d78fe44b69f: Status 404 returned error can't find the container with id 450e3a3791917211586a4afe15a4c1ff055d72c82aec6083bd845d78fe44b69f Jul 24 21:02:38.007546 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:38.007517 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855873111856"] Jul 24 21:02:38.219209 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:38.219108 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873127472" Jul 24 21:02:38.219209 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:38.219126 2574 scope.go:117] "RemoveContainer" containerID="cfd6846c642156486de19b03c8deb9f559d754e7fb3c917f2920898e8a7b4ed7" Jul 24 21:02:38.220586 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:38.220561 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855873111856" event={"ID":"e2465802-dc81-4d47-b5bb-d1930830834b","Type":"ContainerStarted","Data":"450e3a3791917211586a4afe15a4c1ff055d72c82aec6083bd845d78fe44b69f"} Jul 24 21:02:39.228125 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:39.228066 2574 generic.go:356] "Generic (PLEG): container finished" podID="e2465802-dc81-4d47-b5bb-d1930830834b" containerID="a1b8e995dacf7023d0a7a697aa5421c24ba58e79979f44b4cd74cd89e4e16726" exitCode=0 Jul 24 21:02:39.228125 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:39.228103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855873111856" event={"ID":"e2465802-dc81-4d47-b5bb-d1930830834b","Type":"ContainerDied","Data":"a1b8e995dacf7023d0a7a697aa5421c24ba58e79979f44b4cd74cd89e4e16726"} Jul 24 21:02:40.384016 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.383987 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:40.395760 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.395724 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv8ws\" (UniqueName: \"kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws\") pod \"e2465802-dc81-4d47-b5bb-d1930830834b\" (UID: \"e2465802-dc81-4d47-b5bb-d1930830834b\") " Jul 24 21:02:40.399063 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.399025 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws" (OuterVolumeSpecName: "kube-api-access-qv8ws") pod "e2465802-dc81-4d47-b5bb-d1930830834b" (UID: "e2465802-dc81-4d47-b5bb-d1930830834b"). InnerVolumeSpecName "kube-api-access-qv8ws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:02:40.403485 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.403446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-139855873111856_e2465802-dc81-4d47-b5bb-d1930830834b/test-curl-7742-139855873111856/0.log" Jul 24 21:02:40.430713 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.430654 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-139855873111856"] Jul 24 21:02:40.433991 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.433953 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-139855873111856"] Jul 24 21:02:40.496799 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.496703 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv8ws\" (UniqueName: \"kubernetes.io/projected/e2465802-dc81-4d47-b5bb-d1930830834b-kube-api-access-qv8ws\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:02:40.589179 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.589133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7742-139855872825216"] Jul 24 21:02:40.589601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.589579 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2465802-dc81-4d47-b5bb-d1930830834b" containerName="test-curl-7742-139855873111856" Jul 24 21:02:40.589695 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.589603 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2465802-dc81-4d47-b5bb-d1930830834b" containerName="test-curl-7742-139855873111856" Jul 24 21:02:40.589746 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.589693 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2465802-dc81-4d47-b5bb-d1930830834b" containerName="test-curl-7742-139855873111856" Jul 24 21:02:40.592559 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.592535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:40.597272 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.597234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wnts\" (UniqueName: \"kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts\") pod \"test-curl-7742-139855872825216\" (UID: \"59224982-f5a4-42ed-afcd-ba0f592722bb\") " pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:40.599759 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.599727 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855872825216"] Jul 24 21:02:40.698308 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.698270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wnts\" (UniqueName: \"kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts\") pod \"test-curl-7742-139855872825216\" (UID: \"59224982-f5a4-42ed-afcd-ba0f592722bb\") " pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:40.706859 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.706833 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wnts\" (UniqueName: \"kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts\") pod \"test-curl-7742-139855872825216\" (UID: \"59224982-f5a4-42ed-afcd-ba0f592722bb\") " pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:40.903820 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:40.903779 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:41.050437 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:41.050411 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7742-139855872825216"] Jul 24 21:02:41.052579 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:02:41.052548 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59224982_f5a4_42ed_afcd_ba0f592722bb.slice/crio-b581e9d63aa8dbb87b7dcabc086b6e1a282af86f5a01c38ec807b6fe7bbc00c5 WatchSource:0}: Error finding container b581e9d63aa8dbb87b7dcabc086b6e1a282af86f5a01c38ec807b6fe7bbc00c5: Status 404 returned error can't find the container with id b581e9d63aa8dbb87b7dcabc086b6e1a282af86f5a01c38ec807b6fe7bbc00c5 Jul 24 21:02:41.242404 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:41.242310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855872825216" event={"ID":"59224982-f5a4-42ed-afcd-ba0f592722bb","Type":"ContainerStarted","Data":"b581e9d63aa8dbb87b7dcabc086b6e1a282af86f5a01c38ec807b6fe7bbc00c5"} Jul 24 21:02:41.243746 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:41.243721 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:41.243907 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:41.243728 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="450e3a3791917211586a4afe15a4c1ff055d72c82aec6083bd845d78fe44b69f" Jul 24 21:02:41.255257 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:02:41.255219 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7742-139855873111856\" is forbidden: User \"system:node:ip-10-0-132-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-198.ec2.internal' and this object" podUID="e2465802-dc81-4d47-b5bb-d1930830834b" pod="opendatahub/test-curl-7742-139855873111856" Jul 24 21:02:41.719659 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:41.719619 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2465802-dc81-4d47-b5bb-d1930830834b" path="/var/lib/kubelet/pods/e2465802-dc81-4d47-b5bb-d1930830834b/volumes" Jul 24 21:02:42.250714 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:42.250668 2574 generic.go:356] "Generic (PLEG): container finished" podID="59224982-f5a4-42ed-afcd-ba0f592722bb" containerID="226fb54fb68679642fb893568e1bd5641aec47d6cd6675530180023732bc300e" exitCode=0 Jul 24 21:02:42.250934 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:42.250758 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7742-139855872825216" event={"ID":"59224982-f5a4-42ed-afcd-ba0f592722bb","Type":"ContainerDied","Data":"226fb54fb68679642fb893568e1bd5641aec47d6cd6675530180023732bc300e"} Jul 24 21:02:43.393228 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.393195 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:43.415335 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.415307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7742-139855872825216_59224982-f5a4-42ed-afcd-ba0f592722bb/test-curl-7742-139855872825216/0.log" Jul 24 21:02:43.418608 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.418579 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wnts\" (UniqueName: \"kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts\") pod \"59224982-f5a4-42ed-afcd-ba0f592722bb\" (UID: \"59224982-f5a4-42ed-afcd-ba0f592722bb\") " Jul 24 21:02:43.420687 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.420657 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts" (OuterVolumeSpecName: "kube-api-access-2wnts") pod "59224982-f5a4-42ed-afcd-ba0f592722bb" (UID: "59224982-f5a4-42ed-afcd-ba0f592722bb"). InnerVolumeSpecName "kube-api-access-2wnts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:02:43.439103 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.439051 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7742-139855872825216"] Jul 24 21:02:43.442409 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.442375 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7742-139855872825216"] Jul 24 21:02:43.519453 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.519365 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wnts\" (UniqueName: \"kubernetes.io/projected/59224982-f5a4-42ed-afcd-ba0f592722bb-kube-api-access-2wnts\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:02:43.714157 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:43.714124 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59224982-f5a4-42ed-afcd-ba0f592722bb" path="/var/lib/kubelet/pods/59224982-f5a4-42ed-afcd-ba0f592722bb/volumes" Jul 24 21:02:44.263399 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:44.263366 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7742-139855872825216" Jul 24 21:02:44.263606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:44.263400 2574 scope.go:117] "RemoveContainer" containerID="226fb54fb68679642fb893568e1bd5641aec47d6cd6675530180023732bc300e" Jul 24 21:02:53.869396 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.869306 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:02:53.869878 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.869860 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59224982-f5a4-42ed-afcd-ba0f592722bb" containerName="test-curl-7742-139855872825216" Jul 24 21:02:53.869976 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.869881 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="59224982-f5a4-42ed-afcd-ba0f592722bb" containerName="test-curl-7742-139855872825216" Jul 24 21:02:53.870014 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.869989 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="59224982-f5a4-42ed-afcd-ba0f592722bb" containerName="test-curl-7742-139855872825216" Jul 24 21:02:53.874908 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.874875 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.877814 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.877785 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-787669-openshift-default-dockercfg-t5htp\"" Jul 24 21:02:53.881372 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.881334 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:02:53.897610 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25nw2\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.897838 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.897838 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.897838 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.897838 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.898065 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.898065 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.898065 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.897937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.898065 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.898040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.998742 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.998742 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25nw2\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.998965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999432 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.999213 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999432 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.999255 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999582 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.999558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999714 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.999590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:53.999925 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:53.999906 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.001529 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.001508 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.001634 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.001596 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.007623 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.007593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25nw2\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.008261 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.008234 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token\") pod \"e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.188111 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.188004 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:54.342336 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.342306 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:02:54.344456 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:02:54.344425 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b23f6d_0777_42be_b832_cfc9c365f663.slice/crio-a25fa8cb3bdab7a8ef0eebcc902d3f6a4fe31a885e801017570080cac94ff015 WatchSource:0}: Error finding container a25fa8cb3bdab7a8ef0eebcc902d3f6a4fe31a885e801017570080cac94ff015: Status 404 returned error can't find the container with id a25fa8cb3bdab7a8ef0eebcc902d3f6a4fe31a885e801017570080cac94ff015 Jul 24 21:02:54.347240 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.347207 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:02:54.347321 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.347275 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:02:54.347321 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:54.347312 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:02:55.330008 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:55.329956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerStarted","Data":"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a"} Jul 24 21:02:55.330448 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:55.330063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerStarted","Data":"a25fa8cb3bdab7a8ef0eebcc902d3f6a4fe31a885e801017570080cac94ff015"} Jul 24 21:02:55.352661 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:55.352605 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podStartSLOduration=2.352587346 podStartE2EDuration="2.352587346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:02:55.349680535 +0000 UTC m=+2876.147273706" watchObservedRunningTime="2026-07-24 21:02:55.352587346 +0000 UTC m=+2876.150180501" Jul 24 21:02:56.188619 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:56.188581 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:56.193324 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:56.193295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:56.335175 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:56.335135 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:02:56.336105 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:02:56.336064 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:03:12.376276 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:12.376228 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 21:03:12.376800 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:12.376312 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 21:03:13.020285 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.020248 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:03:13.026413 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.026383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.029195 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.029172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5df102-openshift-default-dockercfg-8zbl6\"" Jul 24 21:03:13.039356 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.039320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:03:13.081900 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.081848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.081900 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.081897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.081956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.081980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.082002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.082029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.082057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqpk6\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082236 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.082183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.082598 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.082229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183015 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.182968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqpk6\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183241 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183611 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183611 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.183741 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183719 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.184686 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.183979 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.184686 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.184007 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.184884 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.184433 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.184884 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.184623 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.185630 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.185608 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.186127 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.186063 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.201868 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.201828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.207063 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.207026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqpk6\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6\") pod \"e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.345601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.345500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:13.505095 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.505052 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:03:13.508908 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:03:13.507562 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1842499_e390_4d87_be3c_91b46b511643.slice/crio-7ad9b934f9ebc7cb2ad219c47909d947a36b6073e02796ba000777ef798c8a56 WatchSource:0}: Error finding container 7ad9b934f9ebc7cb2ad219c47909d947a36b6073e02796ba000777ef798c8a56: Status 404 returned error can't find the container with id 7ad9b934f9ebc7cb2ad219c47909d947a36b6073e02796ba000777ef798c8a56 Jul 24 21:03:13.519524 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.510010 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:13.519524 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.510094 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:13.519524 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:13.510127 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:14.436116 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.436053 2574 generic.go:356] "Generic (PLEG): container finished" podID="19b23f6d-0777-42be-b832-cfc9c365f663" containerID="016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a" exitCode=0 Jul 24 21:03:14.436300 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.436128 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerDied","Data":"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a"} Jul 24 21:03:14.436601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.436576 2574 scope.go:117] "RemoveContainer" containerID="016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a" Jul 24 21:03:14.437843 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.437803 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:14.437932 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.437844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerStarted","Data":"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c"} Jul 24 21:03:14.437932 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.437888 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerStarted","Data":"7ad9b934f9ebc7cb2ad219c47909d947a36b6073e02796ba000777ef798c8a56"} Jul 24 21:03:14.437932 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.437897 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:14.438101 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.437933 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:14.476060 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:14.476007 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podStartSLOduration=2.4759890540000002 podStartE2EDuration="2.475989054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:03:14.474464568 +0000 UTC m=+2895.272057686" watchObservedRunningTime="2026-07-24 21:03:14.475989054 +0000 UTC m=+2895.273582227" Jul 24 21:03:15.348523 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:15.348484 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:15.356837 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:15.356800 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:15.450691 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:15.450654 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerStarted","Data":"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4"} Jul 24 21:03:15.450984 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:15.450965 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:15.453798 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:15.453771 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:16.189105 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:16.189043 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:03:16.189382 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:16.189357 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 24 21:03:16.189431 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:16.189408 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 24 21:03:17.188774 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:17.188745 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 24 21:03:17.189281 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:17.189246 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 24 21:03:18.188453 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:18.188415 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 24 21:03:18.188688 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:18.188473 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 24 21:03:19.189044 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:19.189003 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 24 21:03:19.189514 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:19.189085 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 24 21:03:20.192339 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:20.192306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:03:20.192741 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:20.192587 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:03:20.193423 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:20.193406 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:03:28.534982 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.534941 2574 generic.go:356] "Generic (PLEG): container finished" podID="e1842499-e390-4d87-be3c-91b46b511643" containerID="4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c" exitCode=0 Jul 24 21:03:28.535579 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.535015 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerDied","Data":"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c"} Jul 24 21:03:28.535579 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.535532 2574 scope.go:117] "RemoveContainer" containerID="4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c" Jul 24 21:03:28.536690 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.536658 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:28.536803 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.536773 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:28.536870 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:28.536824 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:03:29.547183 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:29.547123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerStarted","Data":"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9"} Jul 24 21:03:30.347296 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:30.347259 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:30.347744 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:30.347715 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 24 21:03:30.347945 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:30.347916 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 24 21:03:30.451311 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:30.451263 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:31.346448 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:31.346404 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 24 21:03:31.347113 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:31.347051 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 24 21:03:32.346409 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:32.346353 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 24 21:03:32.346643 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:32.346435 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 24 21:03:33.346791 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:33.346747 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 24 21:03:33.347472 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:33.347438 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 24 21:03:34.350824 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:34.350790 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:03:34.351836 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:03:34.351816 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:04:46.485340 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.485293 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:04:46.488889 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.488859 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.491728 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.491699 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-fd3ebf-openshift-default-dockercfg-5vkw7\"" Jul 24 21:04:46.500777 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.500743 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:04:46.586587 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.586815 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.586815 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.586815 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.586948 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.586994 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.586938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.587035 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.587019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.587130 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.587115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.587197 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.587155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jg7m\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.687960 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.687899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.687960 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.687959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.687996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jg7m\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688263 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688577 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688577 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688382 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688577 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688433 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688771 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688844 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.688942 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.688917 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.690536 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.690515 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.690768 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.690748 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.697786 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.697746 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.697925 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.697850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jg7m\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m\") pod \"e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.803804 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.803744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:46.959461 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.959425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:04:46.961314 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:04:46.961282 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630c8e48_e76c_4bbb_9993_a07877540347.slice/crio-cff8a22e11c761fb0e5540aad50a34111886ce11a60462866a0e0924c841a98e WatchSource:0}: Error finding container cff8a22e11c761fb0e5540aad50a34111886ce11a60462866a0e0924c841a98e: Status 404 returned error can't find the container with id cff8a22e11c761fb0e5540aad50a34111886ce11a60462866a0e0924c841a98e Jul 24 21:04:46.963786 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.963744 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:04:46.963922 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.963836 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:04:46.963922 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.963886 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:04:46.994564 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:46.994527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerStarted","Data":"cff8a22e11c761fb0e5540aad50a34111886ce11a60462866a0e0924c841a98e"} Jul 24 21:04:48.002519 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:48.002473 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerStarted","Data":"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531"} Jul 24 21:04:48.023193 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:48.023141 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podStartSLOduration=2.02312331 podStartE2EDuration="2.02312331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 21:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:04:48.021992551 +0000 UTC m=+2988.819585703" watchObservedRunningTime="2026-07-24 21:04:48.02312331 +0000 UTC m=+2988.820716414" Jul 24 21:04:48.804301 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:48.804252 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:48.809756 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:48.809727 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:49.008814 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:49.008774 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:49.009713 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:49.009694 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:04:59.980464 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:59.980434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 21:04:59.985493 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:04:59.985462 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 21:05:03.099401 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.099363 2574 generic.go:356] "Generic (PLEG): container finished" podID="630c8e48-e76c-4bbb-9993-a07877540347" containerID="9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531" exitCode=0 Jul 24 21:05:03.099884 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.099438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerDied","Data":"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531"} Jul 24 21:05:03.099884 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.099874 2574 scope.go:117] "RemoveContainer" containerID="9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531" Jul 24 21:05:03.101113 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.101055 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:05:03.101230 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.101148 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:05:03.101230 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:03.101179 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 24 21:05:04.008864 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:04.008819 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:04.107395 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:04.107353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerStarted","Data":"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1"} Jul 24 21:05:04.804817 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:04.804726 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:04.805900 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:04.805871 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 21:05:04.806019 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:04.805940 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 21:05:05.804964 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:05.804921 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 21:05:05.805458 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:05.804986 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 21:05:06.805545 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:06.805499 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 21:05:06.806102 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:06.805598 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 21:05:07.804618 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:07.804573 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 21:05:07.804827 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:07.804651 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 21:05:08.808755 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:08.808720 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:08.809319 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:08.809134 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:08.810020 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:08.810000 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:27.225256 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:27.225221 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:05:27.225836 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:27.225442 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" containerID="cri-o://589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1" gracePeriod=30 Jul 24 21:05:32.487913 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.487824 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:32.547547 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547496 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547751 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547599 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547751 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547632 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547751 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547682 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547751 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547718 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547744 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:05:32.547995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547757 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547808 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jg7m\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547846 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.547995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.547924 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket\") pod \"630c8e48-e76c-4bbb-9993-a07877540347\" (UID: \"630c8e48-e76c-4bbb-9993-a07877540347\") " Jul 24 21:05:32.548301 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548033 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:05:32.548301 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548067 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 21:05:32.548301 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548273 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:05:32.548471 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548368 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.548471 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548391 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.548471 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548406 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.548471 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548419 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/630c8e48-e76c-4bbb-9993-a07877540347-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.548949 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.548926 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data" (OuterVolumeSpecName: "istio-data") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:05:32.550037 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.550006 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:05:32.550360 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.550343 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token" (OuterVolumeSpecName: "istio-token") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:05:32.550573 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.550508 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 21:05:32.550573 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.550516 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m" (OuterVolumeSpecName: "kube-api-access-4jg7m") pod "630c8e48-e76c-4bbb-9993-a07877540347" (UID: "630c8e48-e76c-4bbb-9993-a07877540347"). InnerVolumeSpecName "kube-api-access-4jg7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:05:32.649285 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.649247 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.649285 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.649279 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/630c8e48-e76c-4bbb-9993-a07877540347-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.649285 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.649288 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.649285 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.649297 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jg7m\" (UniqueName: \"kubernetes.io/projected/630c8e48-e76c-4bbb-9993-a07877540347-kube-api-access-4jg7m\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:32.649587 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:32.649307 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/630c8e48-e76c-4bbb-9993-a07877540347-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:05:33.273488 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.273447 2574 generic.go:356] "Generic (PLEG): container finished" podID="630c8e48-e76c-4bbb-9993-a07877540347" containerID="589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1" exitCode=0 Jul 24 21:05:33.273695 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.273495 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" Jul 24 21:05:33.273695 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.273528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerDied","Data":"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1"} Jul 24 21:05:33.273695 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.273586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp" event={"ID":"630c8e48-e76c-4bbb-9993-a07877540347","Type":"ContainerDied","Data":"cff8a22e11c761fb0e5540aad50a34111886ce11a60462866a0e0924c841a98e"} Jul 24 21:05:33.273695 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.273610 2574 scope.go:117] "RemoveContainer" containerID="589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1" Jul 24 21:05:33.284268 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.284243 2574 scope.go:117] "RemoveContainer" containerID="9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531" Jul 24 21:05:33.293592 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.293566 2574 scope.go:117] "RemoveContainer" containerID="589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1" Jul 24 21:05:33.294444 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:05:33.294409 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1\": container with ID starting with 589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1 not found: ID does not exist" containerID="589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1" Jul 24 21:05:33.294555 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.294454 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1"} err="failed to get container status \"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1\": rpc error: code = NotFound desc = could not find container \"589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1\": container with ID starting with 589cbb941ed6e0f79152fb213b938ae59114e457310d8ac9b335111a1fa52fc1 not found: ID does not exist" Jul 24 21:05:33.294555 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.294481 2574 scope.go:117] "RemoveContainer" containerID="9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531" Jul 24 21:05:33.294815 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:05:33.294794 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531\": container with ID starting with 9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531 not found: ID does not exist" containerID="9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531" Jul 24 21:05:33.294864 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.294824 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531"} err="failed to get container status \"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531\": rpc error: code = NotFound desc = could not find container \"9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531\": container with ID starting with 9e00cf4f800a8d75656e64d74149ca57ad88a258598569eb2e654e4abc609531 not found: ID does not exist" Jul 24 21:05:33.296656 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.296630 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:05:33.300754 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.300712 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fd3ebf-openshift-default-59b8d66fdd-nqzjp"] Jul 24 21:05:33.715152 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:05:33.715042 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="630c8e48-e76c-4bbb-9993-a07877540347" path="/var/lib/kubelet/pods/630c8e48-e76c-4bbb-9993-a07877540347/volumes" Jul 24 21:06:41.847505 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:41.847466 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:06:41.848067 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:41.847696 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" containerID="cri-o://f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4" gracePeriod=30 Jul 24 21:06:47.109525 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.109447 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:06:47.190479 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190445 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190698 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190502 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190698 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190598 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190698 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190631 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190698 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190660 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190916 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190795 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:06:47.190916 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190811 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25nw2\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190916 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190852 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.190916 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190898 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.191155 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190922 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs\") pod \"19b23f6d-0777-42be-b832-cfc9c365f663\" (UID: \"19b23f6d-0777-42be-b832-cfc9c365f663\") " Jul 24 21:06:47.191155 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.190981 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:06:47.191363 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.191343 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 21:06:47.191517 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.191356 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.191517 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.191409 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.191517 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.191482 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:06:47.191652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.191594 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data" (OuterVolumeSpecName: "istio-data") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:06:47.193007 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.192979 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:06:47.193007 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.192997 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 21:06:47.193271 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.193253 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token" (OuterVolumeSpecName: "istio-token") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:06:47.193436 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.193415 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2" (OuterVolumeSpecName: "kube-api-access-25nw2") pod "19b23f6d-0777-42be-b832-cfc9c365f663" (UID: "19b23f6d-0777-42be-b832-cfc9c365f663"). InnerVolumeSpecName "kube-api-access-25nw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:06:47.292262 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292218 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292262 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292250 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b23f6d-0777-42be-b832-cfc9c365f663-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292262 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292260 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292262 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292271 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25nw2\" (UniqueName: \"kubernetes.io/projected/19b23f6d-0777-42be-b832-cfc9c365f663-kube-api-access-25nw2\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292534 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292281 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292534 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292290 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b23f6d-0777-42be-b832-cfc9c365f663-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.292534 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.292298 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b23f6d-0777-42be-b832-cfc9c365f663-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:06:47.701598 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.701561 2574 generic.go:356] "Generic (PLEG): container finished" podID="19b23f6d-0777-42be-b832-cfc9c365f663" containerID="f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4" exitCode=0 Jul 24 21:06:47.701808 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.701616 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" Jul 24 21:06:47.701808 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.701632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerDied","Data":"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4"} Jul 24 21:06:47.701808 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.701674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg" event={"ID":"19b23f6d-0777-42be-b832-cfc9c365f663","Type":"ContainerDied","Data":"a25fa8cb3bdab7a8ef0eebcc902d3f6a4fe31a885e801017570080cac94ff015"} Jul 24 21:06:47.701808 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.701697 2574 scope.go:117] "RemoveContainer" containerID="f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4" Jul 24 21:06:47.713567 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.713543 2574 scope.go:117] "RemoveContainer" containerID="016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a" Jul 24 21:06:47.726963 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.726922 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:06:47.727841 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.727710 2574 scope.go:117] "RemoveContainer" containerID="f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4" Jul 24 21:06:47.728397 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:06:47.728360 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4\": container with ID starting with f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4 not found: ID does not exist" containerID="f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4" Jul 24 21:06:47.728505 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.728425 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4"} err="failed to get container status \"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4\": rpc error: code = NotFound desc = could not find container \"f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4\": container with ID starting with f39561b0ee1c89d1d767dae84d1f3d22461713703bdab2366fdf2b10446d1ad4 not found: ID does not exist" Jul 24 21:06:47.728505 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.728456 2574 scope.go:117] "RemoveContainer" containerID="016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a" Jul 24 21:06:47.728827 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:06:47.728794 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a\": container with ID starting with 016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a not found: ID does not exist" containerID="016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a" Jul 24 21:06:47.728895 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.728828 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a"} err="failed to get container status \"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a\": rpc error: code = NotFound desc = could not find container \"016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a\": container with ID starting with 016c8cb393a9bdb949af9e15c34bfd43dffce9ccebc5614dd3b0a093f43fce4a not found: ID does not exist" Jul 24 21:06:47.731160 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:47.731136 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-787669-openshift-default-57f8c65d56-82gbg"] Jul 24 21:06:49.715899 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:06:49.715854 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" path="/var/lib/kubelet/pods/19b23f6d-0777-42be-b832-cfc9c365f663/volumes" Jul 24 21:07:03.808139 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:03.808102 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:07:03.808565 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:03.808349 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" containerID="cri-o://54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9" gracePeriod=30 Jul 24 21:07:04.353140 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:04.353103 2574 patch_prober.go:28] interesting pod/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 21:07:04.353339 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:04.353171 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 21:07:09.066703 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.066675 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:07:09.203807 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203703 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.203807 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203776 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203822 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203853 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203896 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203948 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.203986 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqpk6\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204016 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204046 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204042 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token\") pod \"e1842499-e390-4d87-be3c-91b46b511643\" (UID: \"e1842499-e390-4d87-be3c-91b46b511643\") " Jul 24 21:07:09.204475 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204228 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:09.204475 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204258 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 21:07:09.204475 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204392 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:09.204475 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204467 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:09.204700 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204598 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1842499-e390-4d87-be3c-91b46b511643-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.204700 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204618 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.204700 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204632 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.204700 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204646 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.204927 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.204861 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:09.206425 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.206396 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:07:09.206425 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.206398 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:09.206425 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.206392 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6" (OuterVolumeSpecName: "kube-api-access-gqpk6") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "kube-api-access-gqpk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:07:09.206616 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.206417 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1842499-e390-4d87-be3c-91b46b511643" (UID: "e1842499-e390-4d87-be3c-91b46b511643"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 21:07:09.305856 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.305813 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqpk6\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-kube-api-access-gqpk6\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.305856 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.305851 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1842499-e390-4d87-be3c-91b46b511643-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.305856 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.305862 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.305856 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.305872 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1842499-e390-4d87-be3c-91b46b511643-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.306208 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.305880 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1842499-e390-4d87-be3c-91b46b511643-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:09.836387 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.836348 2574 generic.go:356] "Generic (PLEG): container finished" podID="e1842499-e390-4d87-be3c-91b46b511643" containerID="54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9" exitCode=0 Jul 24 21:07:09.836606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.836413 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" Jul 24 21:07:09.836606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.836427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerDied","Data":"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9"} Jul 24 21:07:09.836606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.836485 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n" event={"ID":"e1842499-e390-4d87-be3c-91b46b511643","Type":"ContainerDied","Data":"7ad9b934f9ebc7cb2ad219c47909d947a36b6073e02796ba000777ef798c8a56"} Jul 24 21:07:09.836606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.836508 2574 scope.go:117] "RemoveContainer" containerID="54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9" Jul 24 21:07:09.846279 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.846258 2574 scope.go:117] "RemoveContainer" containerID="4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c" Jul 24 21:07:09.855971 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.855896 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:07:09.856030 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.855998 2574 scope.go:117] "RemoveContainer" containerID="54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9" Jul 24 21:07:09.856449 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:07:09.856423 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9\": container with ID starting with 54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9 not found: ID does not exist" containerID="54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9" Jul 24 21:07:09.856597 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.856453 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9"} err="failed to get container status \"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9\": rpc error: code = NotFound desc = could not find container \"54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9\": container with ID starting with 54a7e40a19a7118b82176c904f58e5e4b6936ff8fa8f8415e7a4bda1191e0cb9 not found: ID does not exist" Jul 24 21:07:09.856597 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.856472 2574 scope.go:117] "RemoveContainer" containerID="4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c" Jul 24 21:07:09.856884 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:07:09.856846 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c\": container with ID starting with 4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c not found: ID does not exist" containerID="4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c" Jul 24 21:07:09.857001 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.856894 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c"} err="failed to get container status \"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c\": rpc error: code = NotFound desc = could not find container \"4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c\": container with ID starting with 4186823e3f8242f8f6c218a56b8b37e038a4ee382569e093e0b85ec37271c18c not found: ID does not exist" Jul 24 21:07:09.860134 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:09.860103 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df102-openshift-default-8c5f9499b-hwt6n"] Jul 24 21:07:11.714677 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:11.714637 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1842499-e390-4d87-be3c-91b46b511643" path="/var/lib/kubelet/pods/e1842499-e390-4d87-be3c-91b46b511643/volumes" Jul 24 21:07:47.494995 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:47.494949 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 21:07:47.495563 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:47.495254 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" containerID="cri-o://bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1" gracePeriod=30 Jul 24 21:07:52.759728 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.759644 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 21:07:52.917649 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917610 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917649 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917650 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917692 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcm9q\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917732 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917777 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917811 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917842 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.917905 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917864 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.918230 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data\") pod \"19d2b27c-6053-4f47-a104-19162369d117\" (UID: \"19d2b27c-6053-4f47-a104-19162369d117\") " Jul 24 21:07:52.918230 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.917994 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:52.918704 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.918664 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 21:07:52.918704 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.918691 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:52.918956 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.918936 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-credential-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:52.919094 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.919051 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:52.919606 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.919573 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data" (OuterVolumeSpecName: "istio-data") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:52.920443 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.920414 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 21:07:52.921045 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.921017 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 21:07:52.921335 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.921302 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token" (OuterVolumeSpecName: "istio-token") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:07:52.927808 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:52.927771 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q" (OuterVolumeSpecName: "kube-api-access-lcm9q") pod "19d2b27c-6053-4f47-a104-19162369d117" (UID: "19d2b27c-6053-4f47-a104-19162369d117"). InnerVolumeSpecName "kube-api-access-lcm9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020464 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19d2b27c-6053-4f47-a104-19162369d117-istiod-ca-cert\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020503 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19d2b27c-6053-4f47-a104-19162369d117-istio-podinfo\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020516 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-istio-token\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020527 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-certs\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020539 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-workload-socket\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020551 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-data\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020562 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19d2b27c-6053-4f47-a104-19162369d117-istio-envoy\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.020574 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.020576 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcm9q\" (UniqueName: \"kubernetes.io/projected/19d2b27c-6053-4f47-a104-19162369d117-kube-api-access-lcm9q\") on node \"ip-10-0-132-198.ec2.internal\" DevicePath \"\"" Jul 24 21:07:53.078530 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.078488 2574 generic.go:356] "Generic (PLEG): container finished" podID="19d2b27c-6053-4f47-a104-19162369d117" containerID="bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1" exitCode=0 Jul 24 21:07:53.078705 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.078555 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" Jul 24 21:07:53.078705 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.078578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerDied","Data":"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1"} Jul 24 21:07:53.078705 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.078658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t" event={"ID":"19d2b27c-6053-4f47-a104-19162369d117","Type":"ContainerDied","Data":"7dd27003f0e12d6f8cafd2a4c29b7633c36f802afe1e5ab51e0ce4557a41cb94"} Jul 24 21:07:53.078705 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.078684 2574 scope.go:117] "RemoveContainer" containerID="bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1" Jul 24 21:07:53.090256 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.090225 2574 scope.go:117] "RemoveContainer" containerID="51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae" Jul 24 21:07:53.099680 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.099658 2574 scope.go:117] "RemoveContainer" containerID="bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1" Jul 24 21:07:53.100040 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:07:53.100016 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1\": container with ID starting with bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1 not found: ID does not exist" containerID="bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1" Jul 24 21:07:53.100177 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.100046 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1"} err="failed to get container status \"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1\": rpc error: code = NotFound desc = could not find container \"bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1\": container with ID starting with bbd852d2bdaba0d51765b7a6727220523b4ba58156cd1bcb25e3ed74eb61dfa1 not found: ID does not exist" Jul 24 21:07:53.100177 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.100063 2574 scope.go:117] "RemoveContainer" containerID="51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae" Jul 24 21:07:53.100393 ip-10-0-132-198 kubenswrapper[2574]: E0724 21:07:53.100373 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae\": container with ID starting with 51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae not found: ID does not exist" containerID="51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae" Jul 24 21:07:53.100438 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.100400 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae"} err="failed to get container status \"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae\": rpc error: code = NotFound desc = could not find container \"51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae\": container with ID starting with 51e35c96103915aa4e3aaf4d9a011d548eee62b92490ca05f8d88a37d59d17ae not found: ID does not exist" Jul 24 21:07:53.101607 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.101580 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 21:07:53.105413 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.105382 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-449ecf-openshift-default-5499c4575b-fmt7t"] Jul 24 21:07:53.715034 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:53.714997 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19d2b27c-6053-4f47-a104-19162369d117" path="/var/lib/kubelet/pods/19d2b27c-6053-4f47-a104-19162369d117/volumes" Jul 24 21:07:54.223634 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:54.223604 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c48cfcf9b-55w9n_7c28ea3c-947e-410f-b727-63dcf420aab9/copy-manifests/0.log" Jul 24 21:07:54.238362 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:54.238327 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c48cfcf9b-55w9n_7c28ea3c-947e-410f-b727-63dcf420aab9/manager/0.log" Jul 24 21:07:56.090017 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.089968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/pull/0.log" Jul 24 21:07:56.096196 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.096163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/extract/0.log" Jul 24 21:07:56.102397 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.102367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/util/0.log" Jul 24 21:07:56.216950 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.216915 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/util/0.log" Jul 24 21:07:56.224444 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.224418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/pull/0.log" Jul 24 21:07:56.231403 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.231380 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/extract/0.log" Jul 24 21:07:56.347206 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.347118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/util/0.log" Jul 24 21:07:56.354086 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.354045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/pull/0.log" Jul 24 21:07:56.360928 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.360906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/extract/0.log" Jul 24 21:07:56.469330 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.469299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/util/0.log" Jul 24 21:07:56.477245 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.477217 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/pull/0.log" Jul 24 21:07:56.484299 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:56.484279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/extract/0.log" Jul 24 21:07:57.426310 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:57.426265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nrcnr_f91c73e4-0103-46f1-93e5-883d0a54cf1b/manager/0.log" Jul 24 21:07:57.917887 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:57.917827 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x6wb8_f6ec5e55-fe92-4047-9be0-6d5f104b4021/discovery/0.log" Jul 24 21:07:58.622851 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:58.622817 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fffc66b69-rfwq8_fe0f6ad8-dcd1-4280-868a-bb246359eb2c/router/0.log" Jul 24 21:07:58.970674 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:58.970595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pqcf7_4b6b84fa-813b-43ba-80ed-3d94736846d3/main/0.log" Jul 24 21:07:59.304801 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:07:59.304769 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh8b82_23b10dfb-4cd8-4e13-a7ed-9e040d28a295/main/0.log" Jul 24 21:08:08.106838 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:08.106802 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k2lvf_43a29076-4718-4bf1-af6c-dc8ce087247f/global-pull-secret-syncer/0.log" Jul 24 21:08:08.268062 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:08.268029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xt42r_631fedfb-b4fb-415d-8654-74769ffe064a/konnectivity-agent/0.log" Jul 24 21:08:08.314342 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:08.314293 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-198.ec2.internal_ea9ca707d62b1ca03e80e7064968f8e2/haproxy/0.log" Jul 24 21:08:12.776748 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:12.776714 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/extract/0.log" Jul 24 21:08:12.807899 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:12.807870 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/util/0.log" Jul 24 21:08:12.831893 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:12.831868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nclkv_28af354f-a201-43a6-b602-2bc1df92811b/pull/0.log" Jul 24 21:08:12.864595 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:12.864573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/extract/0.log" Jul 24 21:08:12.894123 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:12.894024 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/util/0.log" Jul 24 21:08:13.007804 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.007775 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j75gn_05b350a1-5727-468a-b81b-44b1dd28da27/pull/0.log" Jul 24 21:08:13.077110 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.077058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/extract/0.log" Jul 24 21:08:13.102744 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.102718 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/util/0.log" Jul 24 21:08:13.125057 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.125029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l9fbk_3cf07a1e-191d-4001-a931-89e5cba08e9b/pull/0.log" Jul 24 21:08:13.167822 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.167731 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/extract/0.log" Jul 24 21:08:13.192452 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.192421 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/util/0.log" Jul 24 21:08:13.215465 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.215423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c488s_bcf50178-8981-4a0e-9d19-f4241ffb1d51/pull/0.log" Jul 24 21:08:13.941296 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:13.941262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nrcnr_f91c73e4-0103-46f1-93e5-883d0a54cf1b/manager/0.log" Jul 24 21:08:15.717062 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:15.717029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-zsxkq_97597482-f3d5-486c-a5ec-9f34ce9cd7e2/cluster-monitoring-operator/0.log" Jul 24 21:08:15.866392 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:15.866365 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hgpn_c9359ecb-b1ba-46e9-992f-b99b80bc76fb/node-exporter/0.log" Jul 24 21:08:15.887409 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:15.887379 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hgpn_c9359ecb-b1ba-46e9-992f-b99b80bc76fb/kube-rbac-proxy/0.log" Jul 24 21:08:15.918127 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:15.918096 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hgpn_c9359ecb-b1ba-46e9-992f-b99b80bc76fb/init-textfile/0.log" Jul 24 21:08:16.416429 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:16.416401 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-svfq7_704c999a-2ef4-4c7f-9038-f3ef609955b9/prometheus-operator-admission-webhook/0.log" Jul 24 21:08:16.447441 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:16.447410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b6cb7765d-ml848_40cfb334-36ac-4ce6-97c0-9a016b3dbff2/telemeter-client/0.log" Jul 24 21:08:16.473639 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:16.473608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b6cb7765d-ml848_40cfb334-36ac-4ce6-97c0-9a016b3dbff2/reload/0.log" Jul 24 21:08:16.494032 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:16.494005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b6cb7765d-ml848_40cfb334-36ac-4ce6-97c0-9a016b3dbff2/kube-rbac-proxy/0.log" Jul 24 21:08:17.848570 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:17.848544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-dfsqw_f0503f3e-709c-4ff4-a09c-268dca991206/networking-console-plugin/0.log" Jul 24 21:08:18.094441 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094401 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt"] Jul 24 21:08:18.094760 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094746 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094760 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094776 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094781 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094791 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094796 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.094802 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094803 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094811 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094826 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094832 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094844 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094849 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094857 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094862 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094925 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="630c8e48-e76c-4bbb-9993-a07877540347" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094933 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094939 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094945 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b23f6d-0777-42be-b832-cfc9c365f663" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094952 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094959 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1842499-e390-4d87-be3c-91b46b511643" containerName="istio-proxy" Jul 24 21:08:18.094986 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.094969 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19d2b27c-6053-4f47-a104-19162369d117" containerName="istio-proxy" Jul 24 21:08:18.098353 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.098330 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.100807 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.100748 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s798\"/\"kube-root-ca.crt\"" Jul 24 21:08:18.101835 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.101813 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s798\"/\"openshift-service-ca.crt\"" Jul 24 21:08:18.101914 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.101845 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9s798\"/\"default-dockercfg-4d897\"" Jul 24 21:08:18.107488 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.107460 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt"] Jul 24 21:08:18.133362 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.133314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-proc\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.133362 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.133360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-lib-modules\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.133601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.133390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-podres\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.133601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.133423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-sys\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.133601 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.133559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92dq\" (UniqueName: \"kubernetes.io/projected/41dfaf33-c071-4fff-991e-4e60cde735b3-kube-api-access-s92dq\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234429 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92dq\" (UniqueName: \"kubernetes.io/projected/41dfaf33-c071-4fff-991e-4e60cde735b3-kube-api-access-s92dq\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-proc\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-lib-modules\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-podres\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-sys\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234618 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-proc\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234652 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-sys\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234879 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234679 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-podres\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.234879 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.234680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41dfaf33-c071-4fff-991e-4e60cde735b3-lib-modules\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.242558 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.242513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92dq\" (UniqueName: \"kubernetes.io/projected/41dfaf33-c071-4fff-991e-4e60cde735b3-kube-api-access-s92dq\") pod \"perf-node-gather-daemonset-g8nnt\" (UID: \"41dfaf33-c071-4fff-991e-4e60cde735b3\") " pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.409637 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.409539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:18.500956 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.500901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/2.log" Jul 24 21:08:18.506650 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.506618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r7vws_d4e82ce2-3cf3-45ce-a52b-1aefb8bb0678/console-operator/3.log" Jul 24 21:08:18.554939 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:18.554912 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt"] Jul 24 21:08:18.557901 ip-10-0-132-198 kubenswrapper[2574]: W0724 21:08:18.557867 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod41dfaf33_c071_4fff_991e_4e60cde735b3.slice/crio-f92d99fe38834c12d83f3a490571e781ff64008c88eefff68115904892a84507 WatchSource:0}: Error finding container f92d99fe38834c12d83f3a490571e781ff64008c88eefff68115904892a84507: Status 404 returned error can't find the container with id f92d99fe38834c12d83f3a490571e781ff64008c88eefff68115904892a84507 Jul 24 21:08:19.041311 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.041284 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64cf554964-ch525_1916df96-4d3c-46a1-9c11-4373b26e944f/console/0.log" Jul 24 21:08:19.221924 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.221875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" event={"ID":"41dfaf33-c071-4fff-991e-4e60cde735b3","Type":"ContainerStarted","Data":"be16fdc88bedf7d694a640ac63c8c27ca9da365be26a6a1dfcc5a42410cdea4e"} Jul 24 21:08:19.222156 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.221948 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:19.222156 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.221969 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" event={"ID":"41dfaf33-c071-4fff-991e-4e60cde735b3","Type":"ContainerStarted","Data":"f92d99fe38834c12d83f3a490571e781ff64008c88eefff68115904892a84507"} Jul 24 21:08:19.240988 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.240923 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" podStartSLOduration=1.240906953 podStartE2EDuration="1.240906953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 21:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 21:08:19.237773606 +0000 UTC m=+3200.035366711" watchObservedRunningTime="2026-07-24 21:08:19.240906953 +0000 UTC m=+3200.038500058" Jul 24 21:08:19.710310 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:19.710283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-vtcnf_77bdc938-890a-40c1-99e7-12513dfc01dd/volume-data-source-validator/0.log" Jul 24 21:08:20.781121 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:20.781087 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttvpd_1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0/dns/0.log" Jul 24 21:08:20.803617 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:20.803585 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ttvpd_1a8064ab-1f7b-4bd7-9a91-771eb14ea1f0/kube-rbac-proxy/0.log" Jul 24 21:08:20.872542 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:20.872510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmltz_22f6d2ca-c02d-4a07-8f79-72508fb85ca5/dns-node-resolver/0.log" Jul 24 21:08:21.426151 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:21.426109 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9x9zw_94029bd9-7225-4de9-b477-a42bd882ca7b/node-ca/0.log" Jul 24 21:08:22.501328 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:22.501296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x6wb8_f6ec5e55-fe92-4047-9be0-6d5f104b4021/discovery/0.log" Jul 24 21:08:22.684653 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:22.684622 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fffc66b69-rfwq8_fe0f6ad8-dcd1-4280-868a-bb246359eb2c/router/0.log" Jul 24 21:08:23.540589 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:23.540559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzchh_1723737e-ee40-45e4-8557-0c2eec6c5586/serve-healthcheck-canary/0.log" Jul 24 21:08:24.006155 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:24.006042 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-ldwlf_69d3981a-71a9-4c3f-86ab-69c993f65fce/insights-operator/0.log" Jul 24 21:08:24.006573 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:24.006555 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-ldwlf_69d3981a-71a9-4c3f-86ab-69c993f65fce/insights-operator/1.log" Jul 24 21:08:24.158126 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:24.158087 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrc85_ca531a14-badf-4b57-aad3-776891918500/kube-rbac-proxy/0.log" Jul 24 21:08:24.177377 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:24.177349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrc85_ca531a14-badf-4b57-aad3-776891918500/exporter/0.log" Jul 24 21:08:24.198709 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:24.198683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrc85_ca531a14-badf-4b57-aad3-776891918500/extractor/0.log" Jul 24 21:08:25.238756 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:25.238727 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9s798/perf-node-gather-daemonset-g8nnt" Jul 24 21:08:26.786047 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:26.786013 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c48cfcf9b-55w9n_7c28ea3c-947e-410f-b727-63dcf420aab9/manager/0.log" Jul 24 21:08:26.805000 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:26.804969 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c48cfcf9b-55w9n_7c28ea3c-947e-410f-b727-63dcf420aab9/copy-manifests/0.log" Jul 24 21:08:28.335707 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:28.335679 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-779f8ddb8c-hrh4w_d79b7dc9-88c4-4afc-8058-ba5ee683de24/manager/0.log" Jul 24 21:08:28.390645 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:28.390609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rg8d2_da280311-4b08-406b-8fb0-536f01fa93dd/openshift-lws-operator/0.log" Jul 24 21:08:28.750444 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:28.750353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x6wb8_f6ec5e55-fe92-4047-9be0-6d5f104b4021/discovery/0.log" Jul 24 21:08:28.892300 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:28.892264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fffc66b69-rfwq8_fe0f6ad8-dcd1-4280-868a-bb246359eb2c/router/0.log" Jul 24 21:08:30.438757 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:30.438722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x6wb8_f6ec5e55-fe92-4047-9be0-6d5f104b4021/discovery/0.log" Jul 24 21:08:30.579220 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:30.579186 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fffc66b69-rfwq8_fe0f6ad8-dcd1-4280-868a-bb246359eb2c/router/0.log" Jul 24 21:08:33.188896 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:33.188854 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8gpjn_76418493-0e91-46b8-9bf4-130eadd3ecbb/migrator/0.log" Jul 24 21:08:33.213348 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:33.213320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-8gpjn_76418493-0e91-46b8-9bf4-130eadd3ecbb/graceful-termination/0.log" Jul 24 21:08:33.552970 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:33.552925 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx_afe6cb3c-3c98-4782-b4ea-82ffb4de97cf/kube-storage-version-migrator-operator/1.log" Jul 24 21:08:33.553955 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:33.553892 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-bkpkx_afe6cb3c-3c98-4782-b4ea-82ffb4de97cf/kube-storage-version-migrator-operator/0.log" Jul 24 21:08:34.574380 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.574348 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5ngqv_0ed90b0c-7af8-439d-850b-56e570ae6ca9/kube-multus/0.log" Jul 24 21:08:34.777354 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.777322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/kube-multus-additional-cni-plugins/0.log" Jul 24 21:08:34.799810 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.799780 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/egress-router-binary-copy/0.log" Jul 24 21:08:34.821360 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.821326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/cni-plugins/0.log" Jul 24 21:08:34.844840 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.844808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/bond-cni-plugin/0.log" Jul 24 21:08:34.865154 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.865128 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/routeoverride-cni/0.log" Jul 24 21:08:34.890702 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.890678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/whereabouts-cni-bincopy/0.log" Jul 24 21:08:34.911351 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:34.911322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fhzs_95e4e4ba-043f-429b-be04-a8c39f41b4a4/whereabouts-cni/0.log" Jul 24 21:08:35.161298 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:35.161206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x7rw_409918d3-b2da-4844-a3f8-c341604c02f6/network-metrics-daemon/0.log" Jul 24 21:08:35.179856 ip-10-0-132-198 kubenswrapper[2574]: I0724 21:08:35.179830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x7rw_409918d3-b2da-4844-a3f8-c341604c02f6/kube-rbac-proxy/0.log"