Jul 10 19:05:29.401513 ip-10-0-139-14 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 19:05:29.401526 ip-10-0-139-14 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 19:05:29.401535 ip-10-0-139-14 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 19:05:29.401875 ip-10-0-139-14 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 19:05:40.869260 ip-10-0-139-14 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 19:05:40.869279 ip-10-0-139-14 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 31a0cbf5f99f4fb48f754fe3c26d72aa -- Jul 10 19:07:42.169030 ip-10-0-139-14 systemd[1]: Starting Kubernetes Kubelet... Jul 10 19:07:42.614133 ip-10-0-139-14 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 19:07:42.614133 ip-10-0-139-14 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 19:07:42.614133 ip-10-0-139-14 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 19:07:42.614133 ip-10-0-139-14 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 19:07:42.614133 ip-10-0-139-14 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 19:07:42.615183 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.615063 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623055 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623077 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623081 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623085 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623088 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623092 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.623083 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623095 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623098 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623101 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623104 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623108 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623111 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623114 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623117 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623120 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623123 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623126 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623129 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623131 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623134 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623137 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623140 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623142 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623145 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623148 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623151 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.623347 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623154 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623157 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623159 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623165 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623168 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623171 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623174 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623176 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623179 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623182 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623185 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623187 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623190 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623193 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623197 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623200 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623204 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623207 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623209 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623213 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.623869 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623215 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623218 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623221 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623224 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623227 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623230 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623232 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623235 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623237 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623240 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623243 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623246 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623248 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623251 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623254 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623257 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623259 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623262 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623265 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623267 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.624394 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623271 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623274 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623277 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623280 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623283 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623286 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623292 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623297 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623300 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623303 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623306 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623308 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623312 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623315 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623317 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623320 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623323 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623327 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623329 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623333 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.624908 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623336 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623339 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623342 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623346 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623350 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623353 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623357 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623361 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623365 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623369 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623372 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623375 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.625411 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.623378 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.626760 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626745 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.626760 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626760 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626776 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626780 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626784 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626787 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626790 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626792 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626795 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626798 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626801 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626803 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626806 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626809 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626811 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626814 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626817 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626820 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626824 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626826 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626829 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.626833 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626832 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626835 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626838 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626841 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626844 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626863 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626868 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626871 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626873 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626876 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626879 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626882 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626884 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626887 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626890 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626893 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626896 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626898 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626901 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.627349 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626904 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626906 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626909 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626912 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626914 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626917 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626920 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626922 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626925 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626928 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626931 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626934 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626937 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626939 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626942 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626946 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626951 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626955 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626958 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.627856 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626961 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626965 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626968 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626971 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626976 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626980 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626983 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626986 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626989 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626992 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626996 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.626998 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627001 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627004 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627006 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627009 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627012 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627015 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627017 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.628340 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627020 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627023 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627025 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627028 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627031 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627034 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627037 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627040 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627043 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627047 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627050 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627054 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627058 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627061 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627064 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627067 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627069 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627072 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627075 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627077 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.628854 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627080 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627517 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627522 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627526 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627529 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627533 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627536 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627539 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627542 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627546 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627549 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627553 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627556 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627559 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627562 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627565 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627568 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627571 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627574 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627577 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.629386 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627580 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627584 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627587 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627590 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627593 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627595 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627599 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627602 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627604 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627607 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627610 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627612 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627615 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627618 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627621 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627625 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627629 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627632 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627635 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627638 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.629922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627640 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627643 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627646 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627648 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627651 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627654 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627656 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627659 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627662 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627664 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627668 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627670 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627673 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627677 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627680 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627683 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627686 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627689 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627692 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.630468 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627694 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627697 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627700 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627703 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627705 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627708 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627711 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627715 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627718 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627721 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627723 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627726 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627729 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627731 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627735 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627739 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627742 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627745 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627748 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627752 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.630960 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627754 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627758 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627760 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627778 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627781 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627785 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627790 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627794 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627798 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627801 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627805 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627808 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627811 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627814 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627816 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627819 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627822 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627825 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627828 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627831 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.631471 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.627834 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627910 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627918 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627925 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627930 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627935 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627938 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627943 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627947 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627951 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627954 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627958 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627961 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627965 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627968 2559 flags.go:64] FLAG: --cgroup-root="" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627971 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627975 2559 flags.go:64] FLAG: --client-ca-file="" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627979 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627983 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627988 2559 flags.go:64] FLAG: --cluster-domain="" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627991 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627994 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.627997 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628001 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 19:07:42.632018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628005 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628008 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628011 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628015 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628018 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628022 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628025 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628028 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628032 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628036 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628039 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628042 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628045 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628048 2559 flags.go:64] FLAG: --enable-server="true" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628051 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628077 2559 flags.go:64] FLAG: --event-burst="100" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628081 2559 flags.go:64] FLAG: --event-qps="50" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628085 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628089 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628093 2559 flags.go:64] FLAG: --eviction-hard="" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628097 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628100 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628103 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628106 2559 flags.go:64] FLAG: --eviction-soft="" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628110 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 19:07:42.632621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628113 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628117 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628120 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628124 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628127 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628130 2559 flags.go:64] FLAG: --feature-gates="" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628134 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628137 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628141 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628144 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628148 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628151 2559 flags.go:64] FLAG: --help="false" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628154 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-14.ec2.internal" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628157 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628160 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628163 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628169 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628173 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628176 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628179 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628182 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628185 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628188 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628192 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 19:07:42.633302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628195 2559 flags.go:64] FLAG: --kube-reserved="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628198 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628201 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628204 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628207 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628210 2559 flags.go:64] FLAG: --lock-file="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628214 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628217 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628220 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628227 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628230 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628233 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628236 2559 flags.go:64] FLAG: --logging-format="text" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628239 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628243 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628246 2559 flags.go:64] FLAG: --manifest-url="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628249 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628253 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628256 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628261 2559 flags.go:64] FLAG: --max-pods="110" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628264 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628267 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628270 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628273 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628279 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 19:07:42.633946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628283 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628286 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628294 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628297 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628301 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628304 2559 flags.go:64] FLAG: --pod-cidr="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628307 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628313 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628316 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628319 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628322 2559 flags.go:64] FLAG: --port="10250" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628326 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628329 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099fba69c66bd4bb0" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628332 2559 flags.go:64] FLAG: --qos-reserved="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628335 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628339 2559 flags.go:64] FLAG: --register-node="true" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628342 2559 flags.go:64] FLAG: --register-with-taints="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628346 2559 flags.go:64] FLAG: --registry-burst="10" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628350 2559 flags.go:64] FLAG: --registry-qps="5" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628353 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628356 2559 flags.go:64] FLAG: --reserved-memory="" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628360 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628363 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628366 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628369 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 19:07:42.634584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628372 2559 flags.go:64] FLAG: --runonce="false" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628375 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628379 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628382 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628385 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628389 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628392 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628397 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628400 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628403 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628406 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628409 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628412 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628416 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628419 2559 flags.go:64] FLAG: --system-cgroups="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628422 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628427 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628430 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628433 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628438 2559 flags.go:64] FLAG: --tls-min-version="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628441 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628444 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628447 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628450 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628453 2559 flags.go:64] FLAG: --v="2" Jul 10 19:07:42.635282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628457 2559 flags.go:64] FLAG: --version="false" Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628463 2559 flags.go:64] FLAG: --vmodule="" Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628467 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.628471 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628607 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628613 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628617 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628620 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628623 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628626 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628629 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628632 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628637 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628640 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628644 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628647 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628650 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628653 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628655 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628659 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628661 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.635982 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628664 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628667 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628669 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628672 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628675 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628678 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628681 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628684 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628688 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628692 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628695 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628698 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628702 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628705 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628709 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628712 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628715 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628718 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628721 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.636518 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628724 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628726 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628729 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628731 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628736 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628738 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628743 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628745 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628748 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628751 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628754 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628757 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628760 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628763 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628780 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628783 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628786 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628789 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628792 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628794 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.637162 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628797 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628800 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628803 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628806 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628809 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628811 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628814 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628817 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628820 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628823 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628826 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628828 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628831 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628834 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628837 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628840 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628844 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628847 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628852 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.637693 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628855 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628859 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628862 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628865 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628867 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628871 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628873 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628877 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628879 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628882 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628885 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628889 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628893 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628896 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628900 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628902 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628905 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628908 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628911 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.638247 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628914 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628917 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628920 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628923 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.628926 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.629563 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.636843 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.636863 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.636879 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.636885 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636947 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636953 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636957 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636960 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.638749 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636962 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636965 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636968 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636971 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636975 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636978 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636981 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636984 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636987 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636990 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636993 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636996 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.636999 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637001 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637004 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637007 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637010 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637013 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637015 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637018 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.639138 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637021 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637024 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637028 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637032 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637036 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637041 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637044 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637048 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637052 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637055 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637059 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637061 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637064 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637067 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637070 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637072 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637075 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637078 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637080 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.639647 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637083 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637086 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637089 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637092 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637095 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637098 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637100 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637103 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637106 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637109 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637112 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637115 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637118 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637120 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637123 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637125 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637128 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637131 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637135 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637138 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.640161 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637141 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637144 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637146 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637149 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637152 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637154 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637157 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637160 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637163 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637166 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637169 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637172 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637175 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637177 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637180 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637183 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637186 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637189 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637191 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637195 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.640678 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637206 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637210 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637213 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637216 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637218 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637221 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637224 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637227 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637230 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637233 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637236 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637239 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637243 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637246 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637249 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.641214 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637251 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.637257 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637383 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637387 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637391 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637394 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637397 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637400 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637403 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637406 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637408 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637411 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637414 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637416 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637419 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 19:07:42.641622 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637422 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637425 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637428 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637430 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637433 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637436 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637438 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637441 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637444 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637447 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637449 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637452 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637456 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637460 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637463 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637467 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637470 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637473 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637476 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 19:07:42.642059 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637479 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637481 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637484 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637487 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637490 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637493 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637495 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637499 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637503 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637505 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637508 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637511 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637513 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637516 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637519 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637521 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637524 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637527 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637530 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637532 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 19:07:42.642538 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637535 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637537 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637540 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637543 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637545 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637548 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637551 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637554 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637556 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637560 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637562 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637565 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637568 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637570 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637573 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637575 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637579 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637581 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637584 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637586 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 19:07:42.643071 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637589 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637592 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637594 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637597 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637612 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637616 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637619 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637623 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637626 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637629 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637632 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637635 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637638 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637641 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637644 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637647 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637650 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637654 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637657 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 19:07:42.643578 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637660 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637663 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637665 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637669 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637672 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637674 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637677 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:42.637680 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.637685 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.637831 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.640068 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.641637 2559 server.go:1019] "Starting client certificate rotation" Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.641747 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 19:07:42.644086 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.641788 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 19:07:42.644521 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.644506 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 19:07:42.649094 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.649071 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 19:07:42.661302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.661279 2559 log.go:25] "Validated CRI v1 runtime API" Jul 10 19:07:42.663459 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.663445 2559 log.go:25] "Validated CRI v1 image API" Jul 10 19:07:42.664378 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.664360 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 19:07:42.672321 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.672302 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 95f3506d-6fc3-4f0f-b4a7-dda7c2bc6465:/dev/nvme0n1p4 f326a33f-0d6d-44b3-975a-cb0d13329e79:/dev/nvme0n1p3] Jul 10 19:07:42.672391 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.672321 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 19:07:42.678365 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.678243 2559 manager.go:216] Machine: {Timestamp:2026-07-10 19:07:42.676275627 +0000 UTC m=+0.377626724 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099428 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d049f4d83ff700376489196ae855d SystemUUID:ec2d049f-4d83-ff70-0376-489196ae855d BootID:31a0cbf5-f99f-4fb4-8f75-4fe3c26d72aa Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:4b:04:3e:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:4b:04:3e:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:b7:47:5b:99:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 19:07:42.678365 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.678351 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 19:07:42.678534 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.678435 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 19:07:42.679585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.679552 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 19:07:42.679760 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.679587 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 19:07:42.682324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.682310 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 19:07:42.682387 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.682328 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 19:07:42.682387 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.682341 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 19:07:42.683502 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.683488 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 19:07:42.684994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.684980 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 19:07:42.688193 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688177 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 10 19:07:42.688372 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688359 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 19:07:42.688441 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688402 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 10 19:07:42.688441 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688419 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 19:07:42.688529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688442 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 19:07:42.688529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688458 2559 kubelet.go:398] "Adding apiserver pod source" Jul 10 19:07:42.688529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688473 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 19:07:42.688911 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688896 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 19:07:42.689044 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.688924 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 19:07:42.693084 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.693064 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 19:07:42.693216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.693197 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 19:07:42.695373 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695356 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 19:07:42.695457 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695397 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 19:07:42.695605 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695590 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 19:07:42.695678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695612 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 19:07:42.695678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695622 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 19:07:42.695678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695632 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 19:07:42.695678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695646 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 19:07:42.695678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.695656 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 19:07:42.696208 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696196 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 19:07:42.696260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696211 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 19:07:42.696260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696223 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 19:07:42.696260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696233 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 19:07:42.696260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696248 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 19:07:42.696394 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696262 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 19:07:42.696893 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696881 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 19:07:42.696953 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.696895 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 19:07:42.700397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.700380 2559 server.go:1268] "Started kubelet" Jul 10 19:07:42.700527 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.700472 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 19:07:42.700962 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.700584 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 19:07:42.700962 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.700624 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 19:07:42.701395 ip-10-0-139-14 systemd[1]: Started Kubernetes Kubelet. Jul 10 19:07:42.702385 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.702367 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 19:07:42.702923 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.702905 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 10 19:07:42.703567 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.703404 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 19:07:42.703567 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.703494 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 19:07:42.703567 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.703541 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 19:07:42.707429 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.707408 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 19:07:42.708174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.708151 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 19:07:42.708262 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.708220 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 19:07:42.708428 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.708310 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:42.708904 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.708887 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 19:07:42.708904 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.708906 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 19:07:42.709039 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.709012 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 19:07:42.709103 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.709092 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 10 19:07:42.709151 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.709104 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 10 19:07:42.709901 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.709878 2559 factory.go:55] Registering systemd factory Jul 10 19:07:42.710005 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.709941 2559 factory.go:223] Registration of the systemd container factory successfully Jul 10 19:07:42.710192 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.710177 2559 factory.go:153] Registering CRI-O factory Jul 10 19:07:42.710192 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.710193 2559 factory.go:223] Registration of the crio container factory successfully Jul 10 19:07:42.710299 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.710239 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 19:07:42.710299 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.710259 2559 factory.go:103] Registering Raw factory Jul 10 19:07:42.710299 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.710274 2559 manager.go:1196] Started watching for new ooms in manager Jul 10 19:07:42.711477 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.711460 2559 manager.go:349] Starting recovery of all containers Jul 10 19:07:42.713700 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.713676 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 19:07:42.713839 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.713813 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 19:07:42.715098 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.713798 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c103371f66f6a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.700353184 +0000 UTC m=+0.401704282,LastTimestamp:2026-07-10 19:07:42.700353184 +0000 UTC m=+0.401704282,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.725580 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.725466 2559 manager.go:354] Recovery completed Jul 10 19:07:42.729810 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.729760 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:42.732100 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732076 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:42.732179 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732116 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:42.732179 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732127 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:42.732686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732672 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 19:07:42.732686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732686 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 19:07:42.732842 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732702 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 10 19:07:42.732842 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.732678 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:42.734189 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734173 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:42.734260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734203 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:42.734260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734219 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:42.734260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734181 2559 policy_none.go:49] "None policy: Start" Jul 10 19:07:42.734402 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734281 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 19:07:42.734402 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.734296 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 19:07:42.735440 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.735415 2559 policy_none.go:47] "Start" Jul 10 19:07:42.735915 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.735826 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214b6447 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732100679 +0000 UTC m=+0.433451780,LastTimestamp:2026-07-10 19:07:42.732100679 +0000 UTC m=+0.433451780,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.748246 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.748136 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214bb26c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732120684 +0000 UTC m=+0.433471781,LastTimestamp:2026-07-10 19:07:42.732120684 +0000 UTC m=+0.433471781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.752910 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.752818 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214bdcfa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732131578 +0000 UTC m=+0.433482677,LastTimestamp:2026-07-10 19:07:42.732131578 +0000 UTC m=+0.433482677,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.762964 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.762942 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wz67p" Jul 10 19:07:42.764622 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.764555 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-14.ec2.internal.18c10337214b6447\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214b6447 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732100679 +0000 UTC m=+0.433451780,LastTimestamp:2026-07-10 19:07:42.7341906 +0000 UTC m=+0.435541702,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.769355 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769341 2559 manager.go:337] "Starting Device Plugin manager" Jul 10 19:07:42.769413 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.769375 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 19:07:42.769413 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769388 2559 server.go:87] "Starting device plugin registration server" Jul 10 19:07:42.769688 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769675 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 19:07:42.769759 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769690 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 19:07:42.769824 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769806 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 19:07:42.769912 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769888 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 19:07:42.769912 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.769905 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 19:07:42.770507 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.770484 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 19:07:42.770582 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.770541 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:42.775618 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.775555 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-14.ec2.internal.18c10337214bb26c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214bb26c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732120684 +0000 UTC m=+0.433471781,LastTimestamp:2026-07-10 19:07:42.734209882 +0000 UTC m=+0.435560980,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.785041 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.785000 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wz67p" Jul 10 19:07:42.785924 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.785864 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-14.ec2.internal.18c10337214bdcfa\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c10337214bdcfa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-14.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-10 19:07:42.732131578 +0000 UTC m=+0.433482677,LastTimestamp:2026-07-10 19:07:42.734224945 +0000 UTC m=+0.435576045,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}" Jul 10 19:07:42.870592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.870527 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:42.871980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.871521 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:42.871980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.871551 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:42.871980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.871562 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:42.871980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.871588 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-14.ec2.internal" Jul 10 19:07:42.880615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.880598 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-14.ec2.internal" Jul 10 19:07:42.880685 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.880622 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-14.ec2.internal\": node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:42.900325 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.900302 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:42.902191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.902168 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 19:07:42.903602 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.903572 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 19:07:42.903692 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.903615 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 19:07:42.903692 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.903640 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 19:07:42.903692 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:42.903671 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 19:07:42.908219 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:42.908200 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 19:07:43.001744 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.001691 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.004031 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.004008 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"] Jul 10 19:07:43.004096 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.004086 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:43.005923 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.005903 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:43.006042 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.005939 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:43.006042 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.005951 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:43.007653 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.007633 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:43.007791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.007771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.007872 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.007835 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:43.009738 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.009714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.009861 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.009781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.009861 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.009818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.010249 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010231 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:43.010338 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010261 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:43.010338 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010272 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:43.010338 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010234 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:43.010434 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010347 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:43.010434 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.010362 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:43.012705 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.012688 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.012809 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.012714 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:43.013513 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.013494 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:43.013609 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.013522 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:43.013609 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.013537 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:43.032360 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.032339 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-14.ec2.internal\" not found" node="ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.035969 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.035953 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-14.ec2.internal\" not found" node="ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.102579 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.102554 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.110414 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.110487 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.110487 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.110487 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.110597 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.110597 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.110555 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.203663 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.203593 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.305783 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.305741 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.334195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.334171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.339241 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.339223 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:43.406165 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.406129 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.506722 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.506621 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.607144 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.607113 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.640669 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.640649 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 19:07:43.641141 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.640821 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 19:07:43.707475 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.707441 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.749699 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.749672 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 19:07:43.750572 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.750542 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory" Jul 10 19:07:43.750683 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.750577 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 19:07:43.750683 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.750589 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID" Jul 10 19:07:43.789124 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.788748 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 19:02:42 +0000 UTC" deadline="2028-04-24 13:28:40.84821764 +0000 UTC" Jul 10 19:07:43.789124 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.788786 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15690h20m57.059435868s" Jul 10 19:07:43.807987 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.807961 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:43.872773 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:43.872728 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6fa0e50e78b9ac1702f959fc0c02aa.slice/crio-723e3d9ac70bfcd1efc136f0a1eb9379623246882d8d7fa4eb8dfc53e457f9de WatchSource:0}: Error finding container 723e3d9ac70bfcd1efc136f0a1eb9379623246882d8d7fa4eb8dfc53e457f9de: Status 404 returned error can't find the container with id 723e3d9ac70bfcd1efc136f0a1eb9379623246882d8d7fa4eb8dfc53e457f9de Jul 10 19:07:43.873185 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:43.873158 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51adeb82ef9cf7027b389777ed26ae92.slice/crio-2c6fde7c3e5266741a0aec44fa49203841cddf2e79feb5ce225086548854a786 WatchSource:0}: Error finding container 2c6fde7c3e5266741a0aec44fa49203841cddf2e79feb5ce225086548854a786: Status 404 returned error can't find the container with id 2c6fde7c3e5266741a0aec44fa49203841cddf2e79feb5ce225086548854a786 Jul 10 19:07:43.877099 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.877086 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:07:43.906704 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.906652 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" event={"ID":"51adeb82ef9cf7027b389777ed26ae92","Type":"ContainerStarted","Data":"2c6fde7c3e5266741a0aec44fa49203841cddf2e79feb5ce225086548854a786"} Jul 10 19:07:43.907613 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:43.907592 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerStarted","Data":"723e3d9ac70bfcd1efc136f0a1eb9379623246882d8d7fa4eb8dfc53e457f9de"} Jul 10 19:07:43.908678 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:43.908664 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:44.009177 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.009148 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found" Jul 10 19:07:44.010791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.010776 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 19:07:44.110089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.109993 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" Jul 10 19:07:44.121274 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.121254 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 19:07:44.122940 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.122927 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" Jul 10 19:07:44.130766 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.130752 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 19:07:44.133857 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.133841 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 19:07:44.268300 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.268269 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 19:07:44.689051 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.689010 2559 apiserver.go:52] "Watching apiserver" Jul 10 19:07:44.696616 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.696591 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 19:07:44.697974 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.697943 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-w7hzb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal","openshift-multus/multus-additional-cni-plugins-dxl8l","kube-system/global-pull-secret-syncer-p5pfl","openshift-multus/multus-tq5mt","openshift-multus/network-metrics-daemon-kj6g9","openshift-network-diagnostics/network-check-target-hzkz5","openshift-network-operator/iptables-alerter-x7nfh","openshift-ovn-kubernetes/ovnkube-node-spzpw","kube-system/konnectivity-agent-h52j6","kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp","openshift-cluster-node-tuning-operator/tuned-wfxzw","openshift-dns/node-resolver-t2hjm"] Jul 10 19:07:44.699567 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.699548 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.700924 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.700873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.703213 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.703192 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.704223 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.703421 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 19:07:44.704330 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zhn8c\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704435 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704785 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704807 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704886 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gzr28\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.704932 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.705123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 19:07:44.706291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.705999 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 19:07:44.706760 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.706342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.706834 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.706795 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 19:07:44.707446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.706923 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5b5qp\"" Jul 10 19:07:44.707446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.706965 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 19:07:44.707446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.707245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.707771 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.707742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.708637 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.708603 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 19:07:44.710151 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.710136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.711270 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.711251 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.711361 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.711322 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:44.711537 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.711476 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.711827 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.711808 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jlzcw\"" Jul 10 19:07:44.711919 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.711904 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.712763 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.712744 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 19:07:44.712849 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.712831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.713139 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.713034 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j546m\"" Jul 10 19:07:44.714438 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.714417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.715146 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.715107 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.715146 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.715129 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-99pk4\"" Jul 10 19:07:44.715359 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.715340 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 19:07:44.715474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.715455 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.716110 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.716083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:44.716225 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.716166 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:44.716609 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.716592 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 19:07:44.717590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.717411 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9rcm4\"" Jul 10 19:07:44.717590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.717482 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.717590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.717572 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.717918 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.717902 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.719142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.719276 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovn-node-metrics-cert\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.719348 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b451ded7-e536-4987-9bbb-fe41853b21f0-hosts-file\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.719406 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-host\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.719459 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-k8s-cni-cncf-io\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719459 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-lib-modules\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.719459 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-conf-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-script-lib\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-os-release\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-ovn\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-bin\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-var-lib-kubelet\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-tuned\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.719896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-socket-dir-parent\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-daemon-config\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-etc-kubernetes\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.719896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.719896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5jr\" (UniqueName: \"kubernetes.io/projected/b451ded7-e536-4987-9bbb-fe41853b21f0-kube-api-access-zh5jr\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719912 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719942 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-kubernetes\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-system-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.719991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrcz\" (UniqueName: \"kubernetes.io/projected/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-kube-api-access-wmrcz\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-systemd-units\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-netd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-kubelet\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-log-socket\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720116 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-bin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-multus-certs\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-var-lib-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrxm\" (UniqueName: \"kubernetes.io/projected/d56a244c-3a5b-4db5-b5cd-1022527323cd-kube-api-access-vcrxm\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720211 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cnibin\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720270 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-os-release\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720285 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-tmp\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-hostroot\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-config\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-env-overrides\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b451ded7-e536-4987-9bbb-fe41853b21f0-tmp-dir\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqsm\" (UniqueName: \"kubernetes.io/projected/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-kube-api-access-7kqsm\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-76spq\"" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-systemd\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-kubelet\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.720587 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-system-cni-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-sys\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.720845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-multus\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-node-log\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-modprobe-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-conf\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cni-binary-copy\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-slash\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysconfig\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.720980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr4qm\" (UniqueName: \"kubernetes.io/projected/11f07a8f-1298-40cf-8c51-2351b78f64c4-kube-api-access-zr4qm\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-netns\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-netns\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721080 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-etc-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cnibin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.721755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-run\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.722532 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-systemd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.722532 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.722532 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.721584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 19:07:44.722670 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.722652 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 19:07:44.722964 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.722943 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v8qcr\"" Jul 10 19:07:44.723215 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.723196 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 19:07:44.741976 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.741959 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lz6g" Jul 10 19:07:44.752567 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.752122 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7lz6g" Jul 10 19:07:44.809949 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.809895 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 19:07:44.821478 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821444 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 19:07:44.821620 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-script-lib\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.821620 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-os-release\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.821620 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-device-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821666 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-os-release\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-ovn\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-bin\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-var-lib-kubelet\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-tuned\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821734 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-ovn\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.821812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-socket-dir-parent\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-daemon-config\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821852 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-socket-dir-parent\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-etc-kubernetes\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821907 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-bin\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-var-lib-kubelet\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.821965 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822081 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-etc-kubernetes\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822137 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5jr\" (UniqueName: \"kubernetes.io/projected/b451ded7-e536-4987-9bbb-fe41853b21f0-kube-api-access-zh5jr\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-kubernetes\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-system-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822208 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-script-lib\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrcz\" (UniqueName: \"kubernetes.io/projected/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-kube-api-access-wmrcz\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822226 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-systemd-units\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-kubernetes\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-netd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-kubelet\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-log-socket\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-bin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822410 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-daemon-config\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-multus-certs\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.822551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822464 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-cni-netd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-var-lib-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrxm\" (UniqueName: \"kubernetes.io/projected/d56a244c-3a5b-4db5-b5cd-1022527323cd-kube-api-access-vcrxm\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822510 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-system-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cnibin\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822579 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cnibin\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822621 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-kubelet\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-log-socket\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822739 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-bin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-systemd-units\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-multus-certs\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-os-release\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822854 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-var-lib-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822869 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-os-release\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-tmp\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-hostroot\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.823336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822964 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-hostroot\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.822991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-socket-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cb216bb-f1e3-4fc6-bd3a-50244096348d-iptables-alerter-script\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-config\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-env-overrides\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b451ded7-e536-4987-9bbb-fe41853b21f0-tmp-dir\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqsm\" (UniqueName: \"kubernetes.io/projected/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-kube-api-access-7kqsm\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-systemd\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823193 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e26b32-5782-4db5-ba8b-89726914f1eb-host\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd4nh\" (UniqueName: \"kubernetes.io/projected/34e26b32-5782-4db5-ba8b-89726914f1eb-kube-api-access-pd4nh\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-kubelet\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823281 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-system-cni-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-system-cni-dir\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-sys\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.824177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-multus\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-registration-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9jtk\" (UniqueName: \"kubernetes.io/projected/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kube-api-access-c9jtk\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34e26b32-5782-4db5-ba8b-89726914f1eb-serviceca\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823549 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-systemd\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823577 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovnkube-config\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-dbus\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-node-log\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-modprobe-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-conf\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cni-binary-copy\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbgnz\" (UniqueName: \"kubernetes.io/projected/3f61c17c-2631-46a4-9221-9b16f9d013c1-kube-api-access-qbgnz\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17e67d6e-6944-4d41-93e1-1e4ddd861f24-konnectivity-ca\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-slash\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysconfig\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr4qm\" (UniqueName: \"kubernetes.io/projected/11f07a8f-1298-40cf-8c51-2351b78f64c4-kube-api-access-zr4qm\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d56a244c-3a5b-4db5-b5cd-1022527323cd-env-overrides\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823904 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-netns\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b451ded7-e536-4987-9bbb-fe41853b21f0-tmp-dir\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-netns\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-netns\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-sys-fs\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824031 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-cni-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-etc-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824087 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-node-log\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824117 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-etc-openvswitch\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cnibin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.823676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-kubelet\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-sys\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824175 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-modprobe-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9w5\" (UniqueName: \"kubernetes.io/projected/5cb216bb-f1e3-4fc6-bd3a-50244096348d-kube-api-access-kj9w5\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.825826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824212 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-slash\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysconfig\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-run-netns\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17e67d6e-6944-4d41-93e1-1e4ddd861f24-agent-certs\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824259 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-var-lib-cni-multus\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824277 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cnibin\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-conf\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-run\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cb216bb-f1e3-4fc6-bd3a-50244096348d-host-slash\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824380 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-run\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-systemd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-run-systemd\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824494 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-sysctl-d\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovn-node-metrics-cert\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824502 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a244c-3a5b-4db5-b5cd-1022527323cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b451ded7-e536-4987-9bbb-fe41853b21f0-hosts-file\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.826592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-host\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-k8s-cni-cncf-io\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-kubelet-config\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824762 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824772 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-cni-binary-copy\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-lib-modules\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-conf-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b451ded7-e536-4987-9bbb-fe41853b21f0-hosts-file\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-lib-modules\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824879 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-host-run-k8s-cni-cncf-io\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11f07a8f-1298-40cf-8c51-2351b78f64c4-host\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.824927 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-multus-conf-dir\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.825071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-cni-binary-copy\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.826274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-tmp\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.826331 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11f07a8f-1298-40cf-8c51-2351b78f64c4-etc-tuned\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.827255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.826835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d56a244c-3a5b-4db5-b5cd-1022527323cd-ovn-node-metrics-cert\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.832795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.832710 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrcz\" (UniqueName: \"kubernetes.io/projected/4b8fecf0-21a1-45f1-b58c-da9ce283a5eb-kube-api-access-wmrcz\") pod \"multus-tq5mt\" (UID: \"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb\") " pod="openshift-multus/multus-tq5mt" Jul 10 19:07:44.832795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.832731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqsm\" (UniqueName: \"kubernetes.io/projected/ca29e373-6e15-43a3-83ee-750ee0e1cfaa-kube-api-access-7kqsm\") pod \"multus-additional-cni-plugins-dxl8l\" (UID: \"ca29e373-6e15-43a3-83ee-750ee0e1cfaa\") " pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:44.832795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.832743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr4qm\" (UniqueName: \"kubernetes.io/projected/11f07a8f-1298-40cf-8c51-2351b78f64c4-kube-api-access-zr4qm\") pod \"tuned-wfxzw\" (UID: \"11f07a8f-1298-40cf-8c51-2351b78f64c4\") " pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:44.832795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.832763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5jr\" (UniqueName: \"kubernetes.io/projected/b451ded7-e536-4987-9bbb-fe41853b21f0-kube-api-access-zh5jr\") pod \"node-resolver-t2hjm\" (UID: \"b451ded7-e536-4987-9bbb-fe41853b21f0\") " pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:44.834018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.833996 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrxm\" (UniqueName: \"kubernetes.io/projected/d56a244c-3a5b-4db5-b5cd-1022527323cd-kube-api-access-vcrxm\") pod \"ovnkube-node-spzpw\" (UID: \"d56a244c-3a5b-4db5-b5cd-1022527323cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:44.925820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-socket-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cb216bb-f1e3-4fc6-bd3a-50244096348d-iptables-alerter-script\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e26b32-5782-4db5-ba8b-89726914f1eb-host\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd4nh\" (UniqueName: \"kubernetes.io/projected/34e26b32-5782-4db5-ba8b-89726914f1eb-kube-api-access-pd4nh\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-registration-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925963 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.925974 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:44.925981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.925983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9jtk\" (UniqueName: \"kubernetes.io/projected/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kube-api-access-c9jtk\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34e26b32-5782-4db5-ba8b-89726914f1eb-serviceca\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926030 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-dbus\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.926069 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:45.42602711 +0000 UTC m=+3.127378213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbgnz\" (UniqueName: \"kubernetes.io/projected/3f61c17c-2631-46a4-9221-9b16f9d013c1-kube-api-access-qbgnz\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926116 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-socket-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-dbus\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926167 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-registration-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926208 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e26b32-5782-4db5-ba8b-89726914f1eb-host\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17e67d6e-6944-4d41-93e1-1e4ddd861f24-konnectivity-ca\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-sys-fs\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-sys-fs\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9w5\" (UniqueName: \"kubernetes.io/projected/5cb216bb-f1e3-4fc6-bd3a-50244096348d-kube-api-access-kj9w5\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17e67d6e-6944-4d41-93e1-1e4ddd861f24-agent-certs\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.926453 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:44.926451 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cb216bb-f1e3-4fc6-bd3a-50244096348d-host-slash\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.926498 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:45.426482361 +0000 UTC m=+3.127833456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926515 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cb216bb-f1e3-4fc6-bd3a-50244096348d-host-slash\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-kubelet-config\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926569 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d39c8f-7477-4279-b330-8c35c7db5c40-kubelet-config\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-device-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cb216bb-f1e3-4fc6-bd3a-50244096348d-iptables-alerter-script\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926613 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926656 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eba3867e-8a73-4c21-8bf2-b7b65ad61644-device-dir\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926717 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34e26b32-5782-4db5-ba8b-89726914f1eb-serviceca\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.927123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.926731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17e67d6e-6944-4d41-93e1-1e4ddd861f24-konnectivity-ca\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.928979 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.928957 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17e67d6e-6944-4d41-93e1-1e4ddd861f24-agent-certs\") pod \"konnectivity-agent-h52j6\" (UID: \"17e67d6e-6944-4d41-93e1-1e4ddd861f24\") " pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:44.932595 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.932572 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:07:44.932595 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.932597 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:07:44.932802 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.932610 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:44.932802 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:44.932686 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:07:45.432669829 +0000 UTC m=+3.134020931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:44.934676 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.934653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd4nh\" (UniqueName: \"kubernetes.io/projected/34e26b32-5782-4db5-ba8b-89726914f1eb-kube-api-access-pd4nh\") pod \"node-ca-w7hzb\" (UID: \"34e26b32-5782-4db5-ba8b-89726914f1eb\") " pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:44.935011 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.934988 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbgnz\" (UniqueName: \"kubernetes.io/projected/3f61c17c-2631-46a4-9221-9b16f9d013c1-kube-api-access-qbgnz\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:44.935114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.935081 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9w5\" (UniqueName: \"kubernetes.io/projected/5cb216bb-f1e3-4fc6-bd3a-50244096348d-kube-api-access-kj9w5\") pod \"iptables-alerter-x7nfh\" (UID: \"5cb216bb-f1e3-4fc6-bd3a-50244096348d\") " pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:44.935190 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:44.935170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9jtk\" (UniqueName: \"kubernetes.io/projected/eba3867e-8a73-4c21-8bf2-b7b65ad61644-kube-api-access-c9jtk\") pod \"aws-ebs-csi-driver-node-jpqsp\" (UID: \"eba3867e-8a73-4c21-8bf2-b7b65ad61644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:45.014909 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.014834 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:07:45.025110 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.025073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2hjm" Jul 10 19:07:45.034874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.034851 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" Jul 10 19:07:45.040582 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.040560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" Jul 10 19:07:45.047334 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.047307 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tq5mt" Jul 10 19:07:45.055944 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.055925 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" Jul 10 19:07:45.069599 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.069573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7nfh" Jul 10 19:07:45.075684 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.075659 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:07:45.081480 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.081457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w7hzb" Jul 10 19:07:45.429050 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.428978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:45.429050 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.429029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:45.429252 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.429127 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:45.429252 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.429131 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:45.429252 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.429181 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:46.429166683 +0000 UTC m=+4.130517767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:45.429252 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.429196 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:46.429189821 +0000 UTC m=+4.130540903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:45.530377 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.530342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:45.530560 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.530541 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:07:45.530629 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.530567 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:07:45.530629 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.530581 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:45.530736 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.530653 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:07:46.530633638 +0000 UTC m=+4.231984735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:45.754590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.754511 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 19:02:44 +0000 UTC" deadline="2028-04-15 22:40:56.652324818 +0000 UTC" Jul 10 19:07:45.754590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.754542 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15483h33m10.897786752s" Jul 10 19:07:45.770198 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.770168 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb451ded7_e536_4987_9bbb_fe41853b21f0.slice/crio-6db62bb95c9ea50f3444a13c03b584933b30bb2b97903b79ec739ef9d34d22f8 WatchSource:0}: Error finding container 6db62bb95c9ea50f3444a13c03b584933b30bb2b97903b79ec739ef9d34d22f8: Status 404 returned error can't find the container with id 6db62bb95c9ea50f3444a13c03b584933b30bb2b97903b79ec739ef9d34d22f8 Jul 10 19:07:45.783374 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.783344 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb216bb_f1e3_4fc6_bd3a_50244096348d.slice/crio-25bce21a2d39c589bd541877066bb5153c0c595158eb6ae2097f788e03f23e78 WatchSource:0}: Error finding container 25bce21a2d39c589bd541877066bb5153c0c595158eb6ae2097f788e03f23e78: Status 404 returned error can't find the container with id 25bce21a2d39c589bd541877066bb5153c0c595158eb6ae2097f788e03f23e78 Jul 10 19:07:45.788585 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.788439 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba3867e_8a73_4c21_8bf2_b7b65ad61644.slice/crio-ccd23109e93a494d25145b5d579de0efa010ac2f9e847bc29f3d5553ff056910 WatchSource:0}: Error finding container ccd23109e93a494d25145b5d579de0efa010ac2f9e847bc29f3d5553ff056910: Status 404 returned error can't find the container with id ccd23109e93a494d25145b5d579de0efa010ac2f9e847bc29f3d5553ff056910 Jul 10 19:07:45.789451 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.789428 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e26b32_5782_4db5_ba8b_89726914f1eb.slice/crio-d41ef35ed5d2901ce6d3f42f4e1b90f3a9140f6445c5058d3a182b6a1b992b6d WatchSource:0}: Error finding container d41ef35ed5d2901ce6d3f42f4e1b90f3a9140f6445c5058d3a182b6a1b992b6d: Status 404 returned error can't find the container with id d41ef35ed5d2901ce6d3f42f4e1b90f3a9140f6445c5058d3a182b6a1b992b6d Jul 10 19:07:45.790968 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.790948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56a244c_3a5b_4db5_b5cd_1022527323cd.slice/crio-6cecaf7e4d24e068f72061a17fa7d2cff944624ccad1079ce0f3a65886364398 WatchSource:0}: Error finding container 6cecaf7e4d24e068f72061a17fa7d2cff944624ccad1079ce0f3a65886364398: Status 404 returned error can't find the container with id 6cecaf7e4d24e068f72061a17fa7d2cff944624ccad1079ce0f3a65886364398 Jul 10 19:07:45.804723 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.804626 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f07a8f_1298_40cf_8c51_2351b78f64c4.slice/crio-1a5cb9f6fd117f62ee3bbca66c50ecae17fe0689bdf834bfb47de5b6f32e941f WatchSource:0}: Error finding container 1a5cb9f6fd117f62ee3bbca66c50ecae17fe0689bdf834bfb47de5b6f32e941f: Status 404 returned error can't find the container with id 1a5cb9f6fd117f62ee3bbca66c50ecae17fe0689bdf834bfb47de5b6f32e941f Jul 10 19:07:45.805711 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.805670 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e67d6e_6944_4d41_93e1_1e4ddd861f24.slice/crio-69d741df886ac8b3f45c4963dbac613e8e806cbe6169e84798ff743eaf959208 WatchSource:0}: Error finding container 69d741df886ac8b3f45c4963dbac613e8e806cbe6169e84798ff743eaf959208: Status 404 returned error can't find the container with id 69d741df886ac8b3f45c4963dbac613e8e806cbe6169e84798ff743eaf959208 Jul 10 19:07:45.807142 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.807120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29e373_6e15_43a3_83ee_750ee0e1cfaa.slice/crio-a75f9ce229a0cdc5e499ecc6225703bff7dd5e57eb92dd84d2ecafb41eeec80a WatchSource:0}: Error finding container a75f9ce229a0cdc5e499ecc6225703bff7dd5e57eb92dd84d2ecafb41eeec80a: Status 404 returned error can't find the container with id a75f9ce229a0cdc5e499ecc6225703bff7dd5e57eb92dd84d2ecafb41eeec80a Jul 10 19:07:45.808782 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:07:45.808354 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8fecf0_21a1_45f1_b58c_da9ce283a5eb.slice/crio-39298bc474612ebeedb8553641d792027f88e4ca965407e1e446cd8f0bbc00e9 WatchSource:0}: Error finding container 39298bc474612ebeedb8553641d792027f88e4ca965407e1e446cd8f0bbc00e9: Status 404 returned error can't find the container with id 39298bc474612ebeedb8553641d792027f88e4ca965407e1e446cd8f0bbc00e9 Jul 10 19:07:45.904303 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.904171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:45.904441 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.904171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:45.904441 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.904392 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:45.904530 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:45.904457 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:45.913938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.913908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7nfh" event={"ID":"5cb216bb-f1e3-4fc6-bd3a-50244096348d","Type":"ContainerStarted","Data":"25bce21a2d39c589bd541877066bb5153c0c595158eb6ae2097f788e03f23e78"} Jul 10 19:07:45.917352 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.917330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2hjm" event={"ID":"b451ded7-e536-4987-9bbb-fe41853b21f0","Type":"ContainerStarted","Data":"6db62bb95c9ea50f3444a13c03b584933b30bb2b97903b79ec739ef9d34d22f8"} Jul 10 19:07:45.919502 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.919480 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" event={"ID":"51adeb82ef9cf7027b389777ed26ae92","Type":"ContainerStarted","Data":"13651589421dbed95bc003b50c48e107ce93aac192e9b21e8e2dddfb2b98cd1a"} Jul 10 19:07:45.921155 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.921136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tq5mt" event={"ID":"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb","Type":"ContainerStarted","Data":"39298bc474612ebeedb8553641d792027f88e4ca965407e1e446cd8f0bbc00e9"} Jul 10 19:07:45.922576 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.922557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h52j6" event={"ID":"17e67d6e-6944-4d41-93e1-1e4ddd861f24","Type":"ContainerStarted","Data":"69d741df886ac8b3f45c4963dbac613e8e806cbe6169e84798ff743eaf959208"} Jul 10 19:07:45.926115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.926069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" event={"ID":"11f07a8f-1298-40cf-8c51-2351b78f64c4","Type":"ContainerStarted","Data":"1a5cb9f6fd117f62ee3bbca66c50ecae17fe0689bdf834bfb47de5b6f32e941f"} Jul 10 19:07:45.928362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.928338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w7hzb" event={"ID":"34e26b32-5782-4db5-ba8b-89726914f1eb","Type":"ContainerStarted","Data":"d41ef35ed5d2901ce6d3f42f4e1b90f3a9140f6445c5058d3a182b6a1b992b6d"} Jul 10 19:07:45.929344 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.929323 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" event={"ID":"eba3867e-8a73-4c21-8bf2-b7b65ad61644","Type":"ContainerStarted","Data":"ccd23109e93a494d25145b5d579de0efa010ac2f9e847bc29f3d5553ff056910"} Jul 10 19:07:45.931182 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.931161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerStarted","Data":"a75f9ce229a0cdc5e499ecc6225703bff7dd5e57eb92dd84d2ecafb41eeec80a"} Jul 10 19:07:45.933127 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.933109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"6cecaf7e4d24e068f72061a17fa7d2cff944624ccad1079ce0f3a65886364398"} Jul 10 19:07:45.934600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:45.934549 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" podStartSLOduration=1.9345384270000001 podStartE2EDuration="1.934538427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:07:45.934169325 +0000 UTC m=+3.635520430" watchObservedRunningTime="2026-07-10 19:07:45.934538427 +0000 UTC m=+3.635889530" Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.437478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.437555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.437653 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.437717 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.437746 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:48.437724204 +0000 UTC m=+6.139075293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:46.438364 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.437769 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:48.437753883 +0000 UTC m=+6.139104980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:46.538349 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.538311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:46.538517 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.538473 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:07:46.538517 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.538499 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:07:46.538517 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.538512 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:46.538680 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.538573 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:07:48.538552959 +0000 UTC m=+6.239904044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:46.754927 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.754785 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 19:02:44 +0000 UTC" deadline="2028-04-21 20:33:55.461105346 +0000 UTC" Jul 10 19:07:46.754927 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.754847 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15625h26m8.706263023s" Jul 10 19:07:46.907001 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.906512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:46.907001 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:46.906630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:46.952600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.952563 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa6fa0e50e78b9ac1702f959fc0c02aa" containerID="20051878eecd99cc9f3ae0f893a1cccfe738aaf4a21fd98272ce733169c820fb" exitCode=0 Jul 10 19:07:46.953539 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:46.953489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerDied","Data":"20051878eecd99cc9f3ae0f893a1cccfe738aaf4a21fd98272ce733169c820fb"} Jul 10 19:07:47.904754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:47.904708 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:47.905216 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:47.904855 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:47.905216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:47.904939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:47.905216 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:47.905024 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:47.969877 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:47.969191 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerStarted","Data":"2d00acf4892b7bd1386f22e5df9e3124559f9c2a34c975bc6e1abc72260ec04a"} Jul 10 19:07:47.987729 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:47.986859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" podStartSLOduration=3.986836752 podStartE2EDuration="3.986836752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:07:47.986291935 +0000 UTC m=+5.687643042" watchObservedRunningTime="2026-07-10 19:07:47.986836752 +0000 UTC m=+5.688187862" Jul 10 19:07:48.455963 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:48.455924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:48.456152 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:48.455998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:48.456152 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.456147 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:48.456292 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.456209 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:52.456190087 +0000 UTC m=+10.157541177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:48.456610 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.456591 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:48.456747 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.456646 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:07:52.456631234 +0000 UTC m=+10.157982318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:48.556681 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:48.556640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:48.556883 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.556862 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:07:48.556883 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.556883 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:07:48.557006 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.556896 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:48.557006 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.556955 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:07:52.556938698 +0000 UTC m=+10.258289796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:48.906564 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:48.906047 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:48.906564 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:48.906160 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:49.904135 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:49.904090 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:49.904306 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:49.904226 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:49.904708 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:49.904517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:49.904708 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:49.904643 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:50.904936 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:50.904808 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:50.905386 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:50.904945 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:51.904431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:51.904390 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:51.904431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:51.904427 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:51.904680 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:51.904528 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:51.905004 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:51.904962 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:52.490614 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:52.489948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:52.490614 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:52.490019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:52.490614 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.490179 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:52.490614 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.490238 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:00.490218962 +0000 UTC m=+18.191570050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:07:52.490614 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.490582 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:52.491034 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.490648 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:00.490629435 +0000 UTC m=+18.191980531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:07:52.590386 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:52.590349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:52.590553 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.590534 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:07:52.590629 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.590563 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:07:52.590629 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.590577 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:52.590758 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.590642 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:08:00.590622451 +0000 UTC m=+18.291973556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:07:52.911886 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:52.911802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:52.912385 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:52.911916 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:53.904172 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:53.904134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:53.904344 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:53.904268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:53.904344 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:53.904268 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:53.904456 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:53.904350 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:54.904033 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:54.904001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:54.904467 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:54.904120 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:55.904585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:55.904550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:55.905008 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:55.904595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:55.905008 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:55.904737 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:55.905008 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:55.904802 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:56.904237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:56.904203 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:56.904428 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:56.904346 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:57.904834 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:57.904799 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:57.905311 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:57.904922 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:57.905311 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:57.904980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:57.905311 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:57.905099 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:07:58.903933 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:58.903897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:07:58.904098 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:58.904029 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:07:59.903890 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:59.903857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:07:59.904431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:07:59.903857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:07:59.904431 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:59.903978 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:07:59.904431 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:07:59.904102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:00.547950 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:00.547910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:00.548176 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:00.548010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:00.548176 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.548063 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:08:00.548176 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.548120 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:08:00.548176 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.548133 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:16.548111945 +0000 UTC m=+34.249463043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:08:00.548176 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.548174 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:16.548158037 +0000 UTC m=+34.249509128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:08:00.649183 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:00.649147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:00.649369 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.649344 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:08:00.649369 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.649368 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:08:00.649483 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.649378 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:08:00.649483 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.649438 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:08:16.649416844 +0000 UTC m=+34.350767935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:08:00.904874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:00.904793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:00.905307 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:00.904931 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:01.904601 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:01.904567 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:01.904806 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:01.904572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:01.904806 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:01.904680 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:01.904806 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:01.904792 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:02.905307 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:02.905274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:02.905813 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:02.905357 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:03.904585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:03.904553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:03.904798 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:03.904554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:03.904798 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:03.904672 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:03.904798 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:03.904786 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:04.904129 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:04.903976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:04.904611 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:04.904201 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:05.004579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.004548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" event={"ID":"11f07a8f-1298-40cf-8c51-2351b78f64c4","Type":"ContainerStarted","Data":"9b2210b0c47f1580eb59f71b0ec1878c7b8f4fec6af63c40fa96c4d8a5ff63a6"} Jul 10 19:08:05.005997 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.005976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w7hzb" event={"ID":"34e26b32-5782-4db5-ba8b-89726914f1eb","Type":"ContainerStarted","Data":"fb2c89c0e654064f1c2ac4ebea04045444f96191c3d53cb08492b74fd3663c17"} Jul 10 19:08:05.007374 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.007349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" event={"ID":"eba3867e-8a73-4c21-8bf2-b7b65ad61644","Type":"ContainerStarted","Data":"f418e70cfe08214c45e82a9c498afaee96cf29967a1ea345401c0ca165d33dae"} Jul 10 19:08:05.008791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.008765 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="5aec84860d2bb7382459a713ee556021daa4653c6645d60a11081f14d2ddd492" exitCode=0 Jul 10 19:08:05.008861 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.008840 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"5aec84860d2bb7382459a713ee556021daa4653c6645d60a11081f14d2ddd492"} Jul 10 19:08:05.010953 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.010935 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:08:05.011259 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.011242 2559 generic.go:356] "Generic (PLEG): container finished" podID="d56a244c-3a5b-4db5-b5cd-1022527323cd" containerID="c2827cb8fa9ae34b72caf97ccdf5064e998367677a923a681775e972b9fb238e" exitCode=1 Jul 10 19:08:05.011365 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.011315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"45a494260ea91ef5d2d4209bf67deb9b5559df474f1b98c13e575c7260e0b1f3"} Jul 10 19:08:05.011419 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.011384 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"3edc5e1e15f57a34590e4b95afe2da587f01951d406fb047e05e73fbe5c076c8"} Jul 10 19:08:05.011462 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.011433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerDied","Data":"c2827cb8fa9ae34b72caf97ccdf5064e998367677a923a681775e972b9fb238e"} Jul 10 19:08:05.011497 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.011483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"c64c9c8134a255845961629dc7e43c49bddfd18ec46880f15519a812e6557820"} Jul 10 19:08:05.012521 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.012505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2hjm" event={"ID":"b451ded7-e536-4987-9bbb-fe41853b21f0","Type":"ContainerStarted","Data":"142105e0ca3984f4335696188b26a0dbfeaead6fc6869f06579e7461032ec7b7"} Jul 10 19:08:05.013850 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.013830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tq5mt" event={"ID":"4b8fecf0-21a1-45f1-b58c-da9ce283a5eb","Type":"ContainerStarted","Data":"a2bd7d89cb1132ba70fd0b0a941eee39f0dfe7ce7f700e7830c76253d924991a"} Jul 10 19:08:05.015190 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.015171 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h52j6" event={"ID":"17e67d6e-6944-4d41-93e1-1e4ddd861f24","Type":"ContainerStarted","Data":"f76495e5508c4e48f7049566806e74f528e64a924bcb44fca0e95e9886f98440"} Jul 10 19:08:05.022482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.022447 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wfxzw" podStartSLOduration=4.323754345 podStartE2EDuration="23.022436336s" totalImagesPullingTime="18.698681991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:05.022399787 +0000 UTC m=+22.723750891" watchObservedRunningTime="2026-07-10 19:08:05.022436336 +0000 UTC m=+22.723787470" Jul 10 19:08:05.038108 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.038064 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t2hjm" podStartSLOduration=4.334198204 podStartE2EDuration="23.038046661s" totalImagesPullingTime="18.703848457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:05.037810174 +0000 UTC m=+22.739161278" watchObservedRunningTime="2026-07-10 19:08:05.038046661 +0000 UTC m=+22.739397766" Jul 10 19:08:05.081021 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.080970 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tq5mt" podStartSLOduration=4.348167664 podStartE2EDuration="23.080952892s" totalImagesPullingTime="18.732785228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:05.080108523 +0000 UTC m=+22.781459628" watchObservedRunningTime="2026-07-10 19:08:05.080952892 +0000 UTC m=+22.782303998" Jul 10 19:08:05.112988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.112824 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h52j6" podStartSLOduration=11.69163626 podStartE2EDuration="22.112802496s" totalImagesPullingTime="10.421166236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:05.112464379 +0000 UTC m=+22.813815483" watchObservedRunningTime="2026-07-10 19:08:05.112802496 +0000 UTC m=+22.814153621" Jul 10 19:08:05.128418 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.128366 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w7hzb" podStartSLOduration=3.449647843 podStartE2EDuration="22.128345488s" totalImagesPullingTime="18.678697645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:05.12780849 +0000 UTC m=+22.829159595" watchObservedRunningTime="2026-07-10 19:08:05.128345488 +0000 UTC m=+22.829696594" Jul 10 19:08:05.904472 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.904443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:05.904877 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:05.904576 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:05.904877 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.904615 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:05.904877 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:05.904720 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:05.906796 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.906744 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 19:08:05.986823 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.986794 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:08:05.987346 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:05.987323 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:08:06.019170 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.019144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" event={"ID":"eba3867e-8a73-4c21-8bf2-b7b65ad61644","Type":"ContainerStarted","Data":"c6ae7696c364e800550b634719c7f65727e11e1e020be155219c34388795adf1"} Jul 10 19:08:06.022322 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.022260 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:08:06.022659 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.022639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"4207886d77e70b328a89d40490602aa7517491fdfc35a74282f3af4ffc5fc9c6"} Jul 10 19:08:06.022777 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.022712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"c2cc8f6e6fd5659ca8cf4e6ef3213f5c7c5276a7370435bf726637190cfe940d"} Jul 10 19:08:06.024374 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.024349 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7nfh" event={"ID":"5cb216bb-f1e3-4fc6-bd3a-50244096348d","Type":"ContainerStarted","Data":"bacc5dfe4048a509797a55e42cce1a49156eeed7d38b136edf13f6731ced1422"} Jul 10 19:08:06.041727 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.041674 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7nfh" podStartSLOduration=5.342767902 podStartE2EDuration="24.041662149s" totalImagesPullingTime="18.698894247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:06.041331255 +0000 UTC m=+23.742682358" watchObservedRunningTime="2026-07-10 19:08:06.041662149 +0000 UTC m=+23.743013252" Jul 10 19:08:06.782498 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.782283 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T19:08:05.906760591Z","UUID":"d06bbb42-4b3b-4b4b-8077-39f62b1e71a3","Handler":null,"Name":"","Endpoint":""} Jul 10 19:08:06.783878 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.783853 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 19:08:06.783998 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.783931 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 19:08:06.904263 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:06.904237 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:06.904405 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:06.904325 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:07.029225 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:07.029204 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 19:08:07.029544 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:07.029205 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" event={"ID":"eba3867e-8a73-4c21-8bf2-b7b65ad61644","Type":"ContainerStarted","Data":"5fdf4b9c511fb9ac4d191d4106838209f08e7198e8ce3409509be64d0ecf1b86"} Jul 10 19:08:07.903883 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:07.903842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:07.903883 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:07.903877 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:07.904127 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:07.903990 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:07.904179 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:07.904129 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:08.034542 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:08.034511 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:08:08.035022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:08.034997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"88f23c14a01670b73b6a5ab17860e023b92b6f112cf0a8889eb0cc049b8ae501"} Jul 10 19:08:08.053559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:08.053511 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jpqsp" podStartSLOduration=5.269277953 podStartE2EDuration="26.053496335s" totalImagesPullingTime="20.784218382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:08.052991627 +0000 UTC m=+25.754342730" watchObservedRunningTime="2026-07-10 19:08:08.053496335 +0000 UTC m=+25.754847484" Jul 10 19:08:08.904961 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:08.904777 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:08.905150 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:08.905049 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:09.904306 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:09.904140 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:09.905069 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:09.904140 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:09.905069 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:09.904414 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:09.905069 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:09.904446 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:10.040608 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.040539 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="44764ae154ecbc464399183875c234aeb14e067bfefdbae5e276d0e6eece5753" exitCode=0 Jul 10 19:08:10.040754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.040609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"44764ae154ecbc464399183875c234aeb14e067bfefdbae5e276d0e6eece5753"} Jul 10 19:08:10.044048 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.044033 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:08:10.044344 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.044325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"d6e2bd54bc34fddb1446411523df06f0186699efde67147e1a184fbabab1fc08"} Jul 10 19:08:10.044607 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.044592 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:10.044723 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.044636 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:10.044830 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.044817 2559 scope.go:117] "RemoveContainer" containerID="c2827cb8fa9ae34b72caf97ccdf5064e998367677a923a681775e972b9fb238e" Jul 10 19:08:10.059621 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.059602 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:10.907194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.907166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:10.907634 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:10.907290 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:10.995823 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.995792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:08:10.996006 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.995951 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 19:08:10.996316 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:10.996289 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h52j6" Jul 10 19:08:11.050147 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.050120 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:08:11.050569 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.050543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" event={"ID":"d56a244c-3a5b-4db5-b5cd-1022527323cd","Type":"ContainerStarted","Data":"182d5bf40ecec229cfa0b4a5254102ce3d771a5d2f7b0db58f6024cc2e9b5690"} Jul 10 19:08:11.050913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.050826 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:11.065170 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.065151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:11.077533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.077494 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" podStartSLOduration=10.322997838 podStartE2EDuration="29.077482334s" totalImagesPullingTime="18.754484496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:11.076954543 +0000 UTC m=+28.778305647" watchObservedRunningTime="2026-07-10 19:08:11.077482334 +0000 UTC m=+28.778833437" Jul 10 19:08:11.574643 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.574562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj6g9"] Jul 10 19:08:11.574832 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.574706 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:11.574832 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:11.574820 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:11.577800 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.577774 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p5pfl"] Jul 10 19:08:11.577926 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.577875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:11.577985 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:11.577958 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:11.578588 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.578556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzkz5"] Jul 10 19:08:11.578681 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:11.578643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:11.578757 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:11.578732 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:12.054398 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:12.054316 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="ffc9123636c14727908b1cc163ff137447b5ffe3f1615f443ed30a182dd7463f" exitCode=0 Jul 10 19:08:12.054398 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:12.054353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"ffc9123636c14727908b1cc163ff137447b5ffe3f1615f443ed30a182dd7463f"} Jul 10 19:08:12.905057 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:12.905027 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:12.905225 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:12.905123 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:13.904456 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:13.904383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:13.904883 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:13.904493 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:13.904883 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:13.904542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:13.904883 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:13.904684 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:14.060627 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:14.060595 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="a8bf10bf42ff7c604c4f417c8c8a5650b7a118d768331c613d20f293d15a109c" exitCode=0 Jul 10 19:08:14.060813 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:14.060657 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"a8bf10bf42ff7c604c4f417c8c8a5650b7a118d768331c613d20f293d15a109c"} Jul 10 19:08:14.907150 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:14.907123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:14.907596 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:14.907214 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:15.904805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:15.904711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:15.904965 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:15.904719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:15.904965 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:15.904853 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzkz5" podUID="46d821dc-bfac-4af4-b5f6-580d186a014b" Jul 10 19:08:15.905074 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:15.904973 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kj6g9" podUID="3f61c17c-2631-46a4-9221-9b16f9d013c1" Jul 10 19:08:16.572941 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:16.572905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:16.573411 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:16.572988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:16.573411 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.573068 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 19:08:16.573411 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.573093 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:08:16.573411 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.573149 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret podName:69d39c8f-7477-4279-b330-8c35c7db5c40 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:48.57312781 +0000 UTC m=+66.274478892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret") pod "global-pull-secret-syncer-p5pfl" (UID: "69d39c8f-7477-4279-b330-8c35c7db5c40") : object "kube-system"/"original-pull-secret" not registered Jul 10 19:08:16.573411 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.573171 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs podName:3f61c17c-2631-46a4-9221-9b16f9d013c1 nodeName:}" failed. No retries permitted until 2026-07-10 19:08:48.573159609 +0000 UTC m=+66.274510691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs") pod "network-metrics-daemon-kj6g9" (UID: "3f61c17c-2631-46a4-9221-9b16f9d013c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 19:08:16.673733 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:16.673676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:16.673896 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.673816 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 19:08:16.673896 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.673840 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 19:08:16.673896 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.673852 2559 projected.go:196] Error preparing data for projected volume kube-api-access-z2872 for pod openshift-network-diagnostics/network-check-target-hzkz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:08:16.674019 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.673908 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872 podName:46d821dc-bfac-4af4-b5f6-580d186a014b nodeName:}" failed. No retries permitted until 2026-07-10 19:08:48.673889666 +0000 UTC m=+66.375240753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2872" (UniqueName: "kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872") pod "network-check-target-hzkz5" (UID: "46d821dc-bfac-4af4-b5f6-580d186a014b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 19:08:16.907217 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:16.907146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:16.907375 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:16.907255 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p5pfl" podUID="69d39c8f-7477-4279-b330-8c35c7db5c40" Jul 10 19:08:17.352769 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.352681 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeReady" Jul 10 19:08:17.352903 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.352855 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 19:08:17.398816 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.398784 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lwdfp"] Jul 10 19:08:17.401156 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.401135 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j89hm"] Jul 10 19:08:17.401279 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.401263 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.402881 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.402860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.405804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.405783 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 19:08:17.405804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.405793 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 19:08:17.406081 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.406060 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 19:08:17.406190 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.406108 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 19:08:17.406537 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.406417 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z5rf9\"" Jul 10 19:08:17.406653 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.406543 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 19:08:17.406766 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.406753 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kdxh\"" Jul 10 19:08:17.411868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.411848 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lwdfp"] Jul 10 19:08:17.414673 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.414652 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j89hm"] Jul 10 19:08:17.425306 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.425288 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6p8"] Jul 10 19:08:17.427224 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.427206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.429756 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.429733 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 19:08:17.429850 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.429782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 19:08:17.429850 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.429804 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 19:08:17.429961 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.429936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vnt9v\"" Jul 10 19:08:17.430015 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.429988 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 19:08:17.437480 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.437463 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6p8"] Jul 10 19:08:17.479650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.479808 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgrx2\" (UniqueName: \"kubernetes.io/projected/54315897-7804-4b52-833e-30589686936e-kube-api-access-qgrx2\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.479808 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bfa3b92-263c-4031-93c0-a312624be68d-config-volume\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.479926 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54315897-7804-4b52-833e-30589686936e-cert\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.479926 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bfa3b92-263c-4031-93c0-a312624be68d-tmp-dir\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.479926 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.479899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dbd\" (UniqueName: \"kubernetes.io/projected/1bfa3b92-263c-4031-93c0-a312624be68d-kube-api-access-67dbd\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.581000 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.580972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bfa3b92-263c-4031-93c0-a312624be68d-config-volume\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54315897-7804-4b52-833e-30589686936e-cert\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bfa3b92-263c-4031-93c0-a312624be68d-tmp-dir\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67dbd\" (UniqueName: \"kubernetes.io/projected/1bfa3b92-263c-4031-93c0-a312624be68d-kube-api-access-67dbd\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-crio-socket\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkbc\" (UniqueName: \"kubernetes.io/projected/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-api-access-snkbc\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-data-volume\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.581552 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.581338 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgrx2\" (UniqueName: \"kubernetes.io/projected/54315897-7804-4b52-833e-30589686936e-kube-api-access-qgrx2\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.582092 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.581707 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 19:08:17.582092 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.581840 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls podName:1bfa3b92-263c-4031-93c0-a312624be68d nodeName:}" failed. No retries permitted until 2026-07-10 19:08:18.081817922 +0000 UTC m=+35.783169008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls") pod "dns-default-lwdfp" (UID: "1bfa3b92-263c-4031-93c0-a312624be68d") : secret "dns-default-metrics-tls" not found Jul 10 19:08:17.582198 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.582096 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bfa3b92-263c-4031-93c0-a312624be68d-config-volume\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.582256 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.582225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bfa3b92-263c-4031-93c0-a312624be68d-tmp-dir\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.587235 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.587210 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54315897-7804-4b52-833e-30589686936e-cert\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.589447 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.589425 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dbd\" (UniqueName: \"kubernetes.io/projected/1bfa3b92-263c-4031-93c0-a312624be68d-kube-api-access-67dbd\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:17.590610 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.590591 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgrx2\" (UniqueName: \"kubernetes.io/projected/54315897-7804-4b52-833e-30589686936e-kube-api-access-qgrx2\") pod \"ingress-canary-j89hm\" (UID: \"54315897-7804-4b52-833e-30589686936e\") " pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.682392 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-crio-socket\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682392 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682392 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkbc\" (UniqueName: \"kubernetes.io/projected/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-api-access-snkbc\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682659 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-data-volume\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682659 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.682479 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 19:08:17.682659 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682659 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.682572 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:18.182547359 +0000 UTC m=+35.883898496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : configmap "kube-rbac-proxy" not found Jul 10 19:08:17.682659 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682636 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-crio-socket\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.682885 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.682682 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 19:08:17.682885 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:17.682765 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:18.182746765 +0000 UTC m=+35.884097846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : secret "insights-runtime-extractor-tls" not found Jul 10 19:08:17.682949 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.682884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-data-volume\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.689985 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.689957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2hjm_b451ded7-e536-4987-9bbb-fe41853b21f0/dns-node-resolver/0.log" Jul 10 19:08:17.691013 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.690994 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkbc\" (UniqueName: \"kubernetes.io/projected/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-api-access-snkbc\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:17.694151 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.694121 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-lrl86"] Jul 10 19:08:17.696952 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.696932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.699535 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.699511 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 19:08:17.699627 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.699575 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 19:08:17.699627 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.699590 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 19:08:17.699751 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.699631 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-l4sw7\"" Jul 10 19:08:17.699751 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.699735 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 19:08:17.706594 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.706566 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-lrl86"] Jul 10 19:08:17.721504 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.721482 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j89hm" Jul 10 19:08:17.783769 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.783733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-cabundle\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.783943 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.783825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-key\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.783943 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.783867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28qc\" (UniqueName: \"kubernetes.io/projected/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-kube-api-access-j28qc\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.885049 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.885017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-cabundle\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.885222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.885110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-key\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.885222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.885150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28qc\" (UniqueName: \"kubernetes.io/projected/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-kube-api-access-j28qc\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.885828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.885799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-cabundle\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.887841 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.887817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-signing-key\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.894043 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.894019 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28qc\" (UniqueName: \"kubernetes.io/projected/a127f180-0ce4-4b8c-bbef-39f1e73ae4e1-kube-api-access-j28qc\") pod \"service-ca-79f68b9f4f-lrl86\" (UID: \"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1\") " pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:17.904784 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.904763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:17.904879 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.904765 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:17.907805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.907596 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55ch6\"" Jul 10 19:08:17.907805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.907613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 19:08:17.907805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.907653 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 19:08:17.907805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.907655 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwfmf\"" Jul 10 19:08:17.907805 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:17.907709 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 19:08:18.007307 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.007226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" Jul 10 19:08:18.087518 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.087491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:18.087713 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.087645 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 19:08:18.087789 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.087727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls podName:1bfa3b92-263c-4031-93c0-a312624be68d nodeName:}" failed. No retries permitted until 2026-07-10 19:08:19.087707 +0000 UTC m=+36.789058082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls") pod "dns-default-lwdfp" (UID: "1bfa3b92-263c-4031-93c0-a312624be68d") : secret "dns-default-metrics-tls" not found Jul 10 19:08:18.188046 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.188010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:18.188202 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.188121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:18.188202 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.188145 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 19:08:18.188315 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.188228 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:19.18821342 +0000 UTC m=+36.889564503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : configmap "kube-rbac-proxy" not found Jul 10 19:08:18.188315 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.188236 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 19:08:18.188315 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:18.188295 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:19.188277923 +0000 UTC m=+36.889629022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : secret "insights-runtime-extractor-tls" not found Jul 10 19:08:18.671318 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.671284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w7hzb_34e26b32-5782-4db5-ba8b-89726914f1eb/node-ca/0.log" Jul 10 19:08:18.904123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.903941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:18.908320 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.908299 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 19:08:18.960529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.960503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j89hm"] Jul 10 19:08:18.964140 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:18.964081 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-lrl86"] Jul 10 19:08:18.964295 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:18.964269 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54315897_7804_4b52_833e_30589686936e.slice/crio-830206ef1bd2b3d628e886042a963a997a3a10ffb99b55ca9d73dc8912173f33 WatchSource:0}: Error finding container 830206ef1bd2b3d628e886042a963a997a3a10ffb99b55ca9d73dc8912173f33: Status 404 returned error can't find the container with id 830206ef1bd2b3d628e886042a963a997a3a10ffb99b55ca9d73dc8912173f33 Jul 10 19:08:18.968464 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:18.968438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda127f180_0ce4_4b8c_bbef_39f1e73ae4e1.slice/crio-319c657e0c4e4572c66eafcd9866f08de516dfc22fa1d67362b550c30a16cf43 WatchSource:0}: Error finding container 319c657e0c4e4572c66eafcd9866f08de516dfc22fa1d67362b550c30a16cf43: Status 404 returned error can't find the container with id 319c657e0c4e4572c66eafcd9866f08de516dfc22fa1d67362b550c30a16cf43 Jul 10 19:08:19.077740 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.077667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerStarted","Data":"0562e9541c0365f2f5ee794b2c5da4663d3249af2210ac5ce3de26f91e8eb20a"} Jul 10 19:08:19.078842 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.078812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" event={"ID":"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1","Type":"ContainerStarted","Data":"319c657e0c4e4572c66eafcd9866f08de516dfc22fa1d67362b550c30a16cf43"} Jul 10 19:08:19.079864 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.079844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j89hm" event={"ID":"54315897-7804-4b52-833e-30589686936e","Type":"ContainerStarted","Data":"830206ef1bd2b3d628e886042a963a997a3a10ffb99b55ca9d73dc8912173f33"} Jul 10 19:08:19.096222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.096202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:19.096331 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:19.096318 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 19:08:19.096381 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:19.096374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls podName:1bfa3b92-263c-4031-93c0-a312624be68d nodeName:}" failed. No retries permitted until 2026-07-10 19:08:21.096359605 +0000 UTC m=+38.797710694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls") pod "dns-default-lwdfp" (UID: "1bfa3b92-263c-4031-93c0-a312624be68d") : secret "dns-default-metrics-tls" not found Jul 10 19:08:19.197321 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.197292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:19.197480 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:19.197462 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 19:08:19.197533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.197472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:19.197533 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:19.197527 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:21.19751019 +0000 UTC m=+38.898861272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : secret "insights-runtime-extractor-tls" not found Jul 10 19:08:19.198051 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:19.198033 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:20.089114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:20.089033 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="0562e9541c0365f2f5ee794b2c5da4663d3249af2210ac5ce3de26f91e8eb20a" exitCode=0 Jul 10 19:08:20.089114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:20.089099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"0562e9541c0365f2f5ee794b2c5da4663d3249af2210ac5ce3de26f91e8eb20a"} Jul 10 19:08:21.095760 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:21.095730 2559 generic.go:356] "Generic (PLEG): container finished" podID="ca29e373-6e15-43a3-83ee-750ee0e1cfaa" containerID="c6647c1a8735c302e8443c8c8212b413b30f66c9d23bbe4d75adb239707ad5aa" exitCode=0 Jul 10 19:08:21.096219 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:21.095792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerDied","Data":"c6647c1a8735c302e8443c8c8212b413b30f66c9d23bbe4d75adb239707ad5aa"} Jul 10 19:08:21.113423 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:21.113393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:21.113547 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:21.113521 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 19:08:21.113603 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:21.113579 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls podName:1bfa3b92-263c-4031-93c0-a312624be68d nodeName:}" failed. No retries permitted until 2026-07-10 19:08:25.113562724 +0000 UTC m=+42.814913820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls") pod "dns-default-lwdfp" (UID: "1bfa3b92-263c-4031-93c0-a312624be68d") : secret "dns-default-metrics-tls" not found Jul 10 19:08:21.214414 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:21.214377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:21.214918 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:21.214884 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 19:08:21.215055 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:21.214959 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:25.214938144 +0000 UTC m=+42.916289227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : secret "insights-runtime-extractor-tls" not found Jul 10 19:08:22.102017 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.101943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" event={"ID":"ca29e373-6e15-43a3-83ee-750ee0e1cfaa","Type":"ContainerStarted","Data":"e230d8a7b49d001e6bd65b7fc63b9cad63d1c408389b8a002ada03d7b0817772"} Jul 10 19:08:22.103457 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.103432 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" event={"ID":"a127f180-0ce4-4b8c-bbef-39f1e73ae4e1","Type":"ContainerStarted","Data":"6f21c963e7dfca58c1954e5bff2a0cdaee950fd8d012b995478e16a966fe68fb"} Jul 10 19:08:22.104817 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.104794 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j89hm" event={"ID":"54315897-7804-4b52-833e-30589686936e","Type":"ContainerStarted","Data":"ba2d98d715153a94cca5cfc7be581b5a18426684dc76346565342a40595bf3a3"} Jul 10 19:08:22.124643 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.124596 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dxl8l" podStartSLOduration=9.831558938 podStartE2EDuration="40.124580091s" totalImagesPullingTime="30.293021153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:22.122986299 +0000 UTC m=+39.824337404" watchObservedRunningTime="2026-07-10 19:08:22.124580091 +0000 UTC m=+39.825931194" Jul 10 19:08:22.138864 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.138816 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j89hm" podStartSLOduration=2.44139196 podStartE2EDuration="5.138799383s" totalImagesPullingTime="2.697407423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:22.138247405 +0000 UTC m=+39.839598513" watchObservedRunningTime="2026-07-10 19:08:22.138799383 +0000 UTC m=+39.840150480" Jul 10 19:08:22.157200 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:22.157155 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-lrl86" podStartSLOduration=2.456221453 podStartE2EDuration="5.157139482s" totalImagesPullingTime="2.700918029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:22.157016455 +0000 UTC m=+39.858367560" watchObservedRunningTime="2026-07-10 19:08:22.157139482 +0000 UTC m=+39.858490581" Jul 10 19:08:25.144066 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:25.144033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:25.144515 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:25.144146 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 19:08:25.144515 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:25.144198 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls podName:1bfa3b92-263c-4031-93c0-a312624be68d nodeName:}" failed. No retries permitted until 2026-07-10 19:08:33.144182426 +0000 UTC m=+50.845533528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls") pod "dns-default-lwdfp" (UID: "1bfa3b92-263c-4031-93c0-a312624be68d") : secret "dns-default-metrics-tls" not found Jul 10 19:08:25.244821 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:25.244790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:25.244959 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:25.244928 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 19:08:25.244998 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:08:25.244989 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls podName:a5e0cfc9-e7a1-4907-9332-aebd4686d10e nodeName:}" failed. No retries permitted until 2026-07-10 19:08:33.244971429 +0000 UTC m=+50.946322511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6p8" (UID: "a5e0cfc9-e7a1-4907-9332-aebd4686d10e") : secret "insights-runtime-extractor-tls" not found Jul 10 19:08:33.204997 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.204969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:33.208759 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.208740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bfa3b92-263c-4031-93c0-a312624be68d-metrics-tls\") pod \"dns-default-lwdfp\" (UID: \"1bfa3b92-263c-4031-93c0-a312624be68d\") " pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:33.306165 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.306135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:33.308347 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.308325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5e0cfc9-e7a1-4907-9332-aebd4686d10e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6p8\" (UID: \"a5e0cfc9-e7a1-4907-9332-aebd4686d10e\") " pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:33.315238 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.315219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:33.337499 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.337480 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hd6p8" Jul 10 19:08:33.481431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.481401 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lwdfp"] Jul 10 19:08:33.485687 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:33.485661 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfa3b92_263c_4031_93c0_a312624be68d.slice/crio-bfbc62b8e98516e3ddbefe9032a51c0fd372b0f03c8ec20fcd86046678dc0650 WatchSource:0}: Error finding container bfbc62b8e98516e3ddbefe9032a51c0fd372b0f03c8ec20fcd86046678dc0650: Status 404 returned error can't find the container with id bfbc62b8e98516e3ddbefe9032a51c0fd372b0f03c8ec20fcd86046678dc0650 Jul 10 19:08:33.529736 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:33.529705 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6p8"] Jul 10 19:08:33.533922 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:33.533901 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e0cfc9_e7a1_4907_9332_aebd4686d10e.slice/crio-6d9f96c91cfc722f7cd74b2e846cb2a75b8a7a9cc54e66977b4cfe1b16136ae2 WatchSource:0}: Error finding container 6d9f96c91cfc722f7cd74b2e846cb2a75b8a7a9cc54e66977b4cfe1b16136ae2: Status 404 returned error can't find the container with id 6d9f96c91cfc722f7cd74b2e846cb2a75b8a7a9cc54e66977b4cfe1b16136ae2 Jul 10 19:08:34.138017 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:34.137983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6p8" event={"ID":"a5e0cfc9-e7a1-4907-9332-aebd4686d10e","Type":"ContainerStarted","Data":"6d9f96c91cfc722f7cd74b2e846cb2a75b8a7a9cc54e66977b4cfe1b16136ae2"} Jul 10 19:08:34.139217 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:34.139194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwdfp" event={"ID":"1bfa3b92-263c-4031-93c0-a312624be68d","Type":"ContainerStarted","Data":"bfbc62b8e98516e3ddbefe9032a51c0fd372b0f03c8ec20fcd86046678dc0650"} Jul 10 19:08:38.152829 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:38.152792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6p8" event={"ID":"a5e0cfc9-e7a1-4907-9332-aebd4686d10e","Type":"ContainerStarted","Data":"577e7d7fcae10f144e11bee5799a2ab80fddfbf1d93be883efc9c870ccc619c1"} Jul 10 19:08:38.154569 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:38.154541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwdfp" event={"ID":"1bfa3b92-263c-4031-93c0-a312624be68d","Type":"ContainerStarted","Data":"8fb8ad18aa558aa37a4cf420aea0e2da0989df6eb223a56da4f79ac01e87dd88"} Jul 10 19:08:38.154685 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:38.154596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lwdfp" event={"ID":"1bfa3b92-263c-4031-93c0-a312624be68d","Type":"ContainerStarted","Data":"3a9a7d8acb44b02a47fa31023cd1725f8de25d5f62761583a4fd6a1479e8d15a"} Jul 10 19:08:38.154765 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:38.154721 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:38.170533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:38.170481 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lwdfp" podStartSLOduration=16.679798647 podStartE2EDuration="21.170468449s" totalImagesPullingTime="4.490669802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:38.169070746 +0000 UTC m=+55.870421850" watchObservedRunningTime="2026-07-10 19:08:38.170468449 +0000 UTC m=+55.871819544" Jul 10 19:08:39.160200 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.160163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6p8" event={"ID":"a5e0cfc9-e7a1-4907-9332-aebd4686d10e","Type":"ContainerStarted","Data":"6dde12fb72f3666a79d34af88f578ba04f7f84010270dd23bb7d0b7dc3d93c72"} Jul 10 19:08:39.580341 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.580305 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v"] Jul 10 19:08:39.582458 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.582433 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.586207 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.586180 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 19:08:39.586361 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.586284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 19:08:39.586544 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.586525 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 19:08:39.586781 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.586765 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 19:08:39.587321 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.587290 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2"] Jul 10 19:08:39.590058 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.589475 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.593023 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.592644 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 10 19:08:39.593023 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.592793 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 10 19:08:39.593023 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.592896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 10 19:08:39.593228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.593217 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 10 19:08:39.605462 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.605440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v"] Jul 10 19:08:39.610824 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.610779 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2"] Jul 10 19:08:39.658820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.658793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.658935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.658837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5583bd-6691-4e15-8318-8d5e199d1dc5-tmp\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.658935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.658862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.658935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.658904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkd4b\" (UniqueName: \"kubernetes.io/projected/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-kube-api-access-qkd4b\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.659073 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.658976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5583bd-6691-4e15-8318-8d5e199d1dc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.659073 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.659001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2w4l\" (UniqueName: \"kubernetes.io/projected/9d5583bd-6691-4e15-8318-8d5e199d1dc5-kube-api-access-r2w4l\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.659073 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.659031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.659325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.659083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.659325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.659158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760355 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5583bd-6691-4e15-8318-8d5e199d1dc5-tmp\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.760355 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760355 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkd4b\" (UniqueName: \"kubernetes.io/projected/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-kube-api-access-qkd4b\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5583bd-6691-4e15-8318-8d5e199d1dc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.760531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2w4l\" (UniqueName: \"kubernetes.io/projected/9d5583bd-6691-4e15-8318-8d5e199d1dc5-kube-api-access-r2w4l\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.760531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.760809 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.760596 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d5583bd-6691-4e15-8318-8d5e199d1dc5-tmp\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.761491 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.761444 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.763201 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.763157 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-ca\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.763798 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.763775 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.763899 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.763806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.763899 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.763873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d5583bd-6691-4e15-8318-8d5e199d1dc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.763899 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.763885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.775282 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.775259 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2w4l\" (UniqueName: \"kubernetes.io/projected/9d5583bd-6691-4e15-8318-8d5e199d1dc5-kube-api-access-r2w4l\") pod \"klusterlet-addon-workmgr-546745b48d-dxq7v\" (UID: \"9d5583bd-6691-4e15-8318-8d5e199d1dc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.778186 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.778166 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkd4b\" (UniqueName: \"kubernetes.io/projected/4b6ade4b-7779-40b5-9b46-9ff927ab4a90-kube-api-access-qkd4b\") pod \"cluster-proxy-proxy-agent-65659989c6-f9hw2\" (UID: \"4b6ade4b-7779-40b5-9b46-9ff927ab4a90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:39.895330 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.895246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:39.911937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:39.911912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" Jul 10 19:08:40.046385 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:40.046351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v"] Jul 10 19:08:40.064335 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:40.064309 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2"] Jul 10 19:08:41.024670 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:41.024633 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5583bd_6691_4e15_8318_8d5e199d1dc5.slice/crio-f0cf45aa9cf92d7dfdce99bbe9797ea6f69ced6b0444df007f1910a10d02cc50 WatchSource:0}: Error finding container f0cf45aa9cf92d7dfdce99bbe9797ea6f69ced6b0444df007f1910a10d02cc50: Status 404 returned error can't find the container with id f0cf45aa9cf92d7dfdce99bbe9797ea6f69ced6b0444df007f1910a10d02cc50 Jul 10 19:08:41.025891 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:41.025850 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6ade4b_7779_40b5_9b46_9ff927ab4a90.slice/crio-994e59a86626d1c4a328044355192d23e90d523983984faaf5f3b4db7e0f0327 WatchSource:0}: Error finding container 994e59a86626d1c4a328044355192d23e90d523983984faaf5f3b4db7e0f0327: Status 404 returned error can't find the container with id 994e59a86626d1c4a328044355192d23e90d523983984faaf5f3b4db7e0f0327 Jul 10 19:08:41.167261 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:41.167226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" event={"ID":"4b6ade4b-7779-40b5-9b46-9ff927ab4a90","Type":"ContainerStarted","Data":"994e59a86626d1c4a328044355192d23e90d523983984faaf5f3b4db7e0f0327"} Jul 10 19:08:41.168291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:41.168268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" event={"ID":"9d5583bd-6691-4e15-8318-8d5e199d1dc5","Type":"ContainerStarted","Data":"f0cf45aa9cf92d7dfdce99bbe9797ea6f69ced6b0444df007f1910a10d02cc50"} Jul 10 19:08:41.170212 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:41.170189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6p8" event={"ID":"a5e0cfc9-e7a1-4907-9332-aebd4686d10e","Type":"ContainerStarted","Data":"691bef1d67b76760c0f5e683290a594d699c92552e0570ec678bd2e8e7074b0f"} Jul 10 19:08:41.187755 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:41.187715 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hd6p8" podStartSLOduration=16.773354417 podStartE2EDuration="24.187682247s" totalImagesPullingTime="7.41432783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:08:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:41.18625503 +0000 UTC m=+58.887606144" watchObservedRunningTime="2026-07-10 19:08:41.187682247 +0000 UTC m=+58.889033351" Jul 10 19:08:43.080744 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:43.080712 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-spzpw" Jul 10 19:08:46.193054 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:46.192998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" event={"ID":"4b6ade4b-7779-40b5-9b46-9ff927ab4a90","Type":"ContainerStarted","Data":"a094407d473a9ad1b80dc1b181c6faa84f875a69417f19647ca0247a54bb90e4"} Jul 10 19:08:46.195198 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:46.195168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" event={"ID":"9d5583bd-6691-4e15-8318-8d5e199d1dc5","Type":"ContainerStarted","Data":"7d7758ddbf13ec621f889a7cf2d52ca6ee08a1fee8cd6ed6cf3d640678dc37c2"} Jul 10 19:08:46.195403 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:46.195384 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:46.196728 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:46.196673 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" podUID="9d5583bd-6691-4e15-8318-8d5e199d1dc5" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.10:8000/readyz\": dial tcp 10.134.0.10:8000: connect: connection refused" Jul 10 19:08:46.213847 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:46.213746 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" podStartSLOduration=2.136466047 podStartE2EDuration="7.213731419s" totalImagesPullingTime="5.077265372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:46.213405083 +0000 UTC m=+63.914756188" watchObservedRunningTime="2026-07-10 19:08:46.213731419 +0000 UTC m=+63.915082523" Jul 10 19:08:47.200778 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:47.200746 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" event={"ID":"4b6ade4b-7779-40b5-9b46-9ff927ab4a90","Type":"ContainerStarted","Data":"19db4fdd20e2843b5ad28c5a5423eea170c4e3b5a404037b661a2f6e3178120b"} Jul 10 19:08:47.201255 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:47.200793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" event={"ID":"4b6ade4b-7779-40b5-9b46-9ff927ab4a90","Type":"ContainerStarted","Data":"9bdad0b6ea0d739ca054d0a4b3a069a02f2dd9b3033f566a38ef828b0874c0ae"} Jul 10 19:08:47.202058 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:47.202034 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-546745b48d-dxq7v" Jul 10 19:08:47.219946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:47.219904 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65659989c6-f9hw2" podStartSLOduration=3.145595708 podStartE2EDuration="8.219890382s" totalImagesPullingTime="5.074294674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:47.218252085 +0000 UTC m=+64.919603188" watchObservedRunningTime="2026-07-10 19:08:47.219890382 +0000 UTC m=+64.921241486" Jul 10 19:08:48.162241 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.162214 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lwdfp" Jul 10 19:08:48.627773 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.627734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:48.628174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.627816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:48.630397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.630380 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 19:08:48.631306 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.631285 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 19:08:48.640125 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.640103 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f61c17c-2631-46a4-9221-9b16f9d013c1-metrics-certs\") pod \"network-metrics-daemon-kj6g9\" (UID: \"3f61c17c-2631-46a4-9221-9b16f9d013c1\") " pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:48.640257 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.640135 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d39c8f-7477-4279-b330-8c35c7db5c40-original-pull-secret\") pod \"global-pull-secret-syncer-p5pfl\" (UID: \"69d39c8f-7477-4279-b330-8c35c7db5c40\") " pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:48.728444 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.728414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:48.731059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.731039 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 19:08:48.740998 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.740976 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 19:08:48.751158 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.751134 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2872\" (UniqueName: \"kubernetes.io/projected/46d821dc-bfac-4af4-b5f6-580d186a014b-kube-api-access-z2872\") pod \"network-check-target-hzkz5\" (UID: \"46d821dc-bfac-4af4-b5f6-580d186a014b\") " pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:48.817508 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.817487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55ch6\"" Jul 10 19:08:48.823453 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.823431 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwfmf\"" Jul 10 19:08:48.826036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.826023 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kj6g9" Jul 10 19:08:48.832081 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.832049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:48.919051 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.917965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p5pfl" Jul 10 19:08:48.962729 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.962681 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kj6g9"] Jul 10 19:08:48.965706 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:48.965667 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f61c17c_2631_46a4_9221_9b16f9d013c1.slice/crio-c8f8b25e21b340014b6448b2f6452c80e4938d16d71a407ae854b3b04089e591 WatchSource:0}: Error finding container c8f8b25e21b340014b6448b2f6452c80e4938d16d71a407ae854b3b04089e591: Status 404 returned error can't find the container with id c8f8b25e21b340014b6448b2f6452c80e4938d16d71a407ae854b3b04089e591 Jul 10 19:08:48.980922 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:48.980845 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzkz5"] Jul 10 19:08:48.983224 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:48.983196 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d821dc_bfac_4af4_b5f6_580d186a014b.slice/crio-b12fce6750dd77d42ff6f88b2b92650773f73bf98af43dd4a8eca6b88eb115cb WatchSource:0}: Error finding container b12fce6750dd77d42ff6f88b2b92650773f73bf98af43dd4a8eca6b88eb115cb: Status 404 returned error can't find the container with id b12fce6750dd77d42ff6f88b2b92650773f73bf98af43dd4a8eca6b88eb115cb Jul 10 19:08:49.045246 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:49.045219 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p5pfl"] Jul 10 19:08:49.047744 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:08:49.047716 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d39c8f_7477_4279_b330_8c35c7db5c40.slice/crio-5bb6eca50812ae84c967847e33b97fbdd4db294a314135edb7306392e7b89cf2 WatchSource:0}: Error finding container 5bb6eca50812ae84c967847e33b97fbdd4db294a314135edb7306392e7b89cf2: Status 404 returned error can't find the container with id 5bb6eca50812ae84c967847e33b97fbdd4db294a314135edb7306392e7b89cf2 Jul 10 19:08:49.208754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:49.208724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p5pfl" event={"ID":"69d39c8f-7477-4279-b330-8c35c7db5c40","Type":"ContainerStarted","Data":"5bb6eca50812ae84c967847e33b97fbdd4db294a314135edb7306392e7b89cf2"} Jul 10 19:08:49.209869 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:49.209846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj6g9" event={"ID":"3f61c17c-2631-46a4-9221-9b16f9d013c1","Type":"ContainerStarted","Data":"c8f8b25e21b340014b6448b2f6452c80e4938d16d71a407ae854b3b04089e591"} Jul 10 19:08:49.210811 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:49.210793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzkz5" event={"ID":"46d821dc-bfac-4af4-b5f6-580d186a014b","Type":"ContainerStarted","Data":"b12fce6750dd77d42ff6f88b2b92650773f73bf98af43dd4a8eca6b88eb115cb"} Jul 10 19:08:51.221113 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:51.221035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj6g9" event={"ID":"3f61c17c-2631-46a4-9221-9b16f9d013c1","Type":"ContainerStarted","Data":"d922d17ec19166199d855679c01c7752628b11c684433668702d1721e9b3194d"} Jul 10 19:08:51.221562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:51.221131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kj6g9" event={"ID":"3f61c17c-2631-46a4-9221-9b16f9d013c1","Type":"ContainerStarted","Data":"3e8f047f7aa4fca682a099ee316041e50984bcd120995867e9d2994736e6fec0"} Jul 10 19:08:51.239390 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:51.239337 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kj6g9" podStartSLOduration=67.961464186 podStartE2EDuration="1m9.23931832s" totalImagesPullingTime="1.277854134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:51.236678902 +0000 UTC m=+68.938030010" watchObservedRunningTime="2026-07-10 19:08:51.23931832 +0000 UTC m=+68.940669423" Jul 10 19:08:54.234059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:54.234020 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p5pfl" event={"ID":"69d39c8f-7477-4279-b330-8c35c7db5c40","Type":"ContainerStarted","Data":"96992a28887ce79857bffa182d3eaadf4ab0bb0820e7378fe4a09410118b6d94"} Jul 10 19:08:54.235431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:54.235407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzkz5" event={"ID":"46d821dc-bfac-4af4-b5f6-580d186a014b","Type":"ContainerStarted","Data":"2d6463da005309daaa744d9ed724bc82f9f1837670497af0b2f39c2d1519cd6f"} Jul 10 19:08:54.235538 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:54.235455 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:08:54.251812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:54.251773 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p5pfl" podStartSLOduration=66.573175934 podStartE2EDuration="1m11.251759556s" totalImagesPullingTime="4.678583622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:54.250333461 +0000 UTC m=+71.951684565" watchObservedRunningTime="2026-07-10 19:08:54.251759556 +0000 UTC m=+71.953110660" Jul 10 19:08:54.265786 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:08:54.265748 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzkz5" podStartSLOduration=66.526576155 podStartE2EDuration="1m11.265733944s" totalImagesPullingTime="4.739157789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:08:54.264860007 +0000 UTC m=+71.966211110" watchObservedRunningTime="2026-07-10 19:08:54.265733944 +0000 UTC m=+71.967085057" Jul 10 19:09:03.787489 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.787359 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx"] Jul 10 19:09:03.791270 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.791245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:03.794006 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.793987 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 19:09:03.795358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.795100 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-stkhs\"" Jul 10 19:09:03.795358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.795148 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 19:09:03.795358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.795154 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 19:09:03.795358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.795100 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 19:09:03.795358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.795292 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 19:09:03.804927 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.804905 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx"] Jul 10 19:09:03.844685 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.844651 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-48ccn"] Jul 10 19:09:03.848254 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.848233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.850461 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.850435 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 19:09:03.850655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.850599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cn7z6\"" Jul 10 19:09:03.850655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.850616 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 19:09:03.850812 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.850739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 19:09:03.945754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-textfile\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.945754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-metrics-client-ca\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.945988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-tls\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.945988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79544\" (UniqueName: \"kubernetes.io/projected/0d464521-65b3-4d35-a257-80a1b280d418-kube-api-access-79544\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.945988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-sys\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.945988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:03.945988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smjcs\" (UniqueName: \"kubernetes.io/projected/9a428fe2-02ce-404f-8bd7-256fc147dc50-kube-api-access-smjcs\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.945993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.946019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-accelerators-collector-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.946049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a428fe2-02ce-404f-8bd7-256fc147dc50-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.946153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.946187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-root\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:03.946243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:03.946212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-wtmp\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smjcs\" (UniqueName: \"kubernetes.io/projected/9a428fe2-02ce-404f-8bd7-256fc147dc50-kube-api-access-smjcs\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.047585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-accelerators-collector-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a428fe2-02ce-404f-8bd7-256fc147dc50-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-root\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-wtmp\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-textfile\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-metrics-client-ca\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.047868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-root\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-tls\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:09:04.047883 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79544\" (UniqueName: \"kubernetes.io/projected/0d464521-65b3-4d35-a257-80a1b280d418-kube-api-access-79544\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-wtmp\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.047989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-sys\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:09:04.048022 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls podName:9a428fe2-02ce-404f-8bd7-256fc147dc50 nodeName:}" failed. No retries permitted until 2026-07-10 19:09:04.547998997 +0000 UTC m=+82.249350101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-bsjdx" (UID: "9a428fe2-02ce-404f-8bd7-256fc147dc50") : secret "openshift-state-metrics-tls" not found Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.048216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d464521-65b3-4d35-a257-80a1b280d418-sys\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a428fe2-02ce-404f-8bd7-256fc147dc50-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.048754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048732 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-textfile\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048854 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-accelerators-collector-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.048930 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.048915 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d464521-65b3-4d35-a257-80a1b280d418-metrics-client-ca\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.051079 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.051053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-tls\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.051167 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.051053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d464521-65b3-4d35-a257-80a1b280d418-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.051167 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.051096 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.061103 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.061076 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79544\" (UniqueName: \"kubernetes.io/projected/0d464521-65b3-4d35-a257-80a1b280d418-kube-api-access-79544\") pod \"node-exporter-48ccn\" (UID: \"0d464521-65b3-4d35-a257-80a1b280d418\") " pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.061374 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.061356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smjcs\" (UniqueName: \"kubernetes.io/projected/9a428fe2-02ce-404f-8bd7-256fc147dc50-kube-api-access-smjcs\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.158310 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.158276 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48ccn" Jul 10 19:09:04.172425 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:09:04.172392 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d464521_65b3_4d35_a257_80a1b280d418.slice/crio-dc294b800064ce269965fde256ee8e2db60f94e5e611b31a4581347b68fe4582 WatchSource:0}: Error finding container dc294b800064ce269965fde256ee8e2db60f94e5e611b31a4581347b68fe4582: Status 404 returned error can't find the container with id dc294b800064ce269965fde256ee8e2db60f94e5e611b31a4581347b68fe4582 Jul 10 19:09:04.267401 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.267365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48ccn" event={"ID":"0d464521-65b3-4d35-a257-80a1b280d418","Type":"ContainerStarted","Data":"dc294b800064ce269965fde256ee8e2db60f94e5e611b31a4581347b68fe4582"} Jul 10 19:09:04.552716 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.552674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.554962 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.554936 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a428fe2-02ce-404f-8bd7-256fc147dc50-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bsjdx\" (UID: \"9a428fe2-02ce-404f-8bd7-256fc147dc50\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.701343 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.701312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" Jul 10 19:09:04.847194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:04.847127 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx"] Jul 10 19:09:04.850013 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:09:04.849988 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a428fe2_02ce_404f_8bd7_256fc147dc50.slice/crio-dbdf42e0a110ee33a366ae2ad10402fca6004d49bef4aa53844099bd2d2a23c1 WatchSource:0}: Error finding container dbdf42e0a110ee33a366ae2ad10402fca6004d49bef4aa53844099bd2d2a23c1: Status 404 returned error can't find the container with id dbdf42e0a110ee33a366ae2ad10402fca6004d49bef4aa53844099bd2d2a23c1 Jul 10 19:09:05.272846 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:05.272821 2559 generic.go:356] "Generic (PLEG): container finished" podID="0d464521-65b3-4d35-a257-80a1b280d418" containerID="3ca1497f13d16395d873ae603a0568914423a0546078c5c6165c957108fe3fc6" exitCode=0 Jul 10 19:09:05.272960 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:05.272897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48ccn" event={"ID":"0d464521-65b3-4d35-a257-80a1b280d418","Type":"ContainerDied","Data":"3ca1497f13d16395d873ae603a0568914423a0546078c5c6165c957108fe3fc6"} Jul 10 19:09:05.274661 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:05.274636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" event={"ID":"9a428fe2-02ce-404f-8bd7-256fc147dc50","Type":"ContainerStarted","Data":"bd8c23dee16dd27ab7b717b68b0f78d70e3c99e3ebe95c6a63e808fcea60dcd6"} Jul 10 19:09:05.275018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:05.274685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" event={"ID":"9a428fe2-02ce-404f-8bd7-256fc147dc50","Type":"ContainerStarted","Data":"cd084b6adbfdee149cda63529a3cafc730c1d8e7334519cdbf5448cf21e89f6a"} Jul 10 19:09:05.275018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:05.274729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" event={"ID":"9a428fe2-02ce-404f-8bd7-256fc147dc50","Type":"ContainerStarted","Data":"dbdf42e0a110ee33a366ae2ad10402fca6004d49bef4aa53844099bd2d2a23c1"} Jul 10 19:09:06.286165 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:06.286129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48ccn" event={"ID":"0d464521-65b3-4d35-a257-80a1b280d418","Type":"ContainerStarted","Data":"6bc731d58ce96f683e56451b7823ccec89b1cca74690c663c44ac2d09a207307"} Jul 10 19:09:06.286518 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:06.286223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48ccn" event={"ID":"0d464521-65b3-4d35-a257-80a1b280d418","Type":"ContainerStarted","Data":"8eacb5e320650f16a0ef85d786d1b8d799c14572d2df5a98e58c647540bea8ff"} Jul 10 19:09:06.306874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:06.306837 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-48ccn" podStartSLOduration=2.288217782 podStartE2EDuration="3.306822438s" totalImagesPullingTime="952.959445ms" totalInitContainerRuntime="65.645211ms" isStatefulPod=true podCreationTimestamp="2026-07-10 19:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:06.306769002 +0000 UTC m=+84.008120109" watchObservedRunningTime="2026-07-10 19:09:06.306822438 +0000 UTC m=+84.008173535" Jul 10 19:09:07.291509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:07.291474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" event={"ID":"9a428fe2-02ce-404f-8bd7-256fc147dc50","Type":"ContainerStarted","Data":"5b34eb4ec542f8542582ff317cfc6807048f95fba7caa00d02ff9d7a37d5fa2a"} Jul 10 19:09:07.312553 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:07.309027 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bsjdx" podStartSLOduration=3.166393082 podStartE2EDuration="4.309008175s" totalImagesPullingTime="1.142615093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:07.306755493 +0000 UTC m=+85.008106596" watchObservedRunningTime="2026-07-10 19:09:07.309008175 +0000 UTC m=+85.010359284" Jul 10 19:09:08.587473 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.587442 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll"] Jul 10 19:09:08.590844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.590824 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:08.593090 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.593073 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 19:09:08.593188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.593152 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kc8xw\"" Jul 10 19:09:08.599634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.599616 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll"] Jul 10 19:09:08.683889 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.683856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzp6p\" (UniqueName: \"kubernetes.io/projected/9462828d-f9e7-4f69-a502-8fa96d637fc7-kube-api-access-hzp6p\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:08.684033 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.683902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:08.784266 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.784232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzp6p\" (UniqueName: \"kubernetes.io/projected/9462828d-f9e7-4f69-a502-8fa96d637fc7-kube-api-access-hzp6p\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:08.784415 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.784271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:08.784476 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:09:08.784418 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 10 19:09:08.784527 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:09:08.784481 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert podName:9462828d-f9e7-4f69-a502-8fa96d637fc7 nodeName:}" failed. No retries permitted until 2026-07-10 19:09:09.284466424 +0000 UTC m=+86.985817511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-qgjll" (UID: "9462828d-f9e7-4f69-a502-8fa96d637fc7") : secret "monitoring-plugin-cert" not found Jul 10 19:09:08.792509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:08.792478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzp6p\" (UniqueName: \"kubernetes.io/projected/9462828d-f9e7-4f69-a502-8fa96d637fc7-kube-api-access-hzp6p\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:09.289121 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:09.289091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:09.291549 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:09.291521 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9462828d-f9e7-4f69-a502-8fa96d637fc7-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qgjll\" (UID: \"9462828d-f9e7-4f69-a502-8fa96d637fc7\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:09.499858 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:09.499832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:09.631866 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:09.631835 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll"] Jul 10 19:09:09.634658 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:09:09.634634 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9462828d_f9e7_4f69_a502_8fa96d637fc7.slice/crio-b45d061928a4e0d96c025c2a947063e25605cb0120e989783c2c927f9d0f6a80 WatchSource:0}: Error finding container b45d061928a4e0d96c025c2a947063e25605cb0120e989783c2c927f9d0f6a80: Status 404 returned error can't find the container with id b45d061928a4e0d96c025c2a947063e25605cb0120e989783c2c927f9d0f6a80 Jul 10 19:09:10.316758 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:10.316728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" event={"ID":"9462828d-f9e7-4f69-a502-8fa96d637fc7","Type":"ContainerStarted","Data":"b45d061928a4e0d96c025c2a947063e25605cb0120e989783c2c927f9d0f6a80"} Jul 10 19:09:12.324216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:12.324182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" event={"ID":"9462828d-f9e7-4f69-a502-8fa96d637fc7","Type":"ContainerStarted","Data":"b81e01028826de523a7c3dc140f331d474b40fb1441089754bc652dc4331c4c0"} Jul 10 19:09:12.324596 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:12.324394 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:12.329025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:12.329005 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" Jul 10 19:09:12.340798 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:12.340753 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qgjll" podStartSLOduration=2.570973347 podStartE2EDuration="4.34073563s" totalImagesPullingTime="1.769762283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:09:12.340320588 +0000 UTC m=+90.041671717" watchObservedRunningTime="2026-07-10 19:09:12.34073563 +0000 UTC m=+90.042086735" Jul 10 19:09:25.241349 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:09:25.241316 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzkz5" Jul 10 19:12:42.724166 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:12:42.724138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:12:42.726078 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:12:42.726056 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:12:42.731579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:12:42.731558 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 19:13:15.634142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.634102 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fn8h"] Jul 10 19:13:15.637218 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.637191 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.639752 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.639721 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 19:13:15.639844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.639781 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 19:13:15.640748 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.640733 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sxbs7\"" Jul 10 19:13:15.646638 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.646611 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fn8h"] Jul 10 19:13:15.774180 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.774127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b27g6\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-kube-api-access-b27g6\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.774350 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.774211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.874945 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.874910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b27g6\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-kube-api-access-b27g6\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.875101 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.874965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.884260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.884195 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-bound-sa-token\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.885199 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.885181 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b27g6\" (UniqueName: \"kubernetes.io/projected/b3e38c58-70e8-4446-9d2c-03b06d9c6820-kube-api-access-b27g6\") pod \"cert-manager-55b4d954d5-5fn8h\" (UID: \"b3e38c58-70e8-4446-9d2c-03b06d9c6820\") " pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:15.946405 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:15.946375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5fn8h" Jul 10 19:13:16.074201 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:16.074050 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5fn8h"] Jul 10 19:13:16.076912 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:13:16.076884 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3e38c58_70e8_4446_9d2c_03b06d9c6820.slice/crio-7a699542de706f27da8b5608cca9357a3ff895947761bcbe4ad9d9fb0e200079 WatchSource:0}: Error finding container 7a699542de706f27da8b5608cca9357a3ff895947761bcbe4ad9d9fb0e200079: Status 404 returned error can't find the container with id 7a699542de706f27da8b5608cca9357a3ff895947761bcbe4ad9d9fb0e200079 Jul 10 19:13:16.078785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:16.078768 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:13:16.127878 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:16.127840 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5fn8h" event={"ID":"b3e38c58-70e8-4446-9d2c-03b06d9c6820","Type":"ContainerStarted","Data":"7a699542de706f27da8b5608cca9357a3ff895947761bcbe4ad9d9fb0e200079"} Jul 10 19:13:19.142482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:19.142444 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5fn8h" event={"ID":"b3e38c58-70e8-4446-9d2c-03b06d9c6820","Type":"ContainerStarted","Data":"b22b92d7622ded14c534d5a8f19f88e1adc3870ff3efaa9d014529d7fa777001"} Jul 10 19:13:19.162168 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:19.162122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5fn8h" podStartSLOduration=1.303358338 podStartE2EDuration="4.16210382s" totalImagesPullingTime="2.858745482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:13:19.160060565 +0000 UTC m=+336.861411669" watchObservedRunningTime="2026-07-10 19:13:19.16210382 +0000 UTC m=+336.863454923" Jul 10 19:13:23.615885 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.615855 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb"] Jul 10 19:13:23.618923 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.618908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.621364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.621341 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 19:13:23.621483 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.621373 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 19:13:23.622338 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.622321 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dgbjw\"" Jul 10 19:13:23.628050 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.628032 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb"] Jul 10 19:13:23.629138 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.629118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99040977-24c5-4c51-94e8-3cde325379d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.629219 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.629153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8rk\" (UniqueName: \"kubernetes.io/projected/99040977-24c5-4c51-94e8-3cde325379d3-kube-api-access-ds8rk\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.729481 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.729446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99040977-24c5-4c51-94e8-3cde325379d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.729624 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.729495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8rk\" (UniqueName: \"kubernetes.io/projected/99040977-24c5-4c51-94e8-3cde325379d3-kube-api-access-ds8rk\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.729859 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.729838 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99040977-24c5-4c51-94e8-3cde325379d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.738101 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.738069 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8rk\" (UniqueName: \"kubernetes.io/projected/99040977-24c5-4c51-94e8-3cde325379d3-kube-api-access-ds8rk\") pod \"openshift-lws-operator-fd8ccff4c-6l4sb\" (UID: \"99040977-24c5-4c51-94e8-3cde325379d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:23.928072 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:23.928002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" Jul 10 19:13:24.054197 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:24.054163 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb"] Jul 10 19:13:24.057102 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:13:24.057076 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99040977_24c5_4c51_94e8_3cde325379d3.slice/crio-db137a0331482d653465efdf708f6380b34bde557c90a5b5d876d5fd07047a7a WatchSource:0}: Error finding container db137a0331482d653465efdf708f6380b34bde557c90a5b5d876d5fd07047a7a: Status 404 returned error can't find the container with id db137a0331482d653465efdf708f6380b34bde557c90a5b5d876d5fd07047a7a Jul 10 19:13:24.160940 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:24.160914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" event={"ID":"99040977-24c5-4c51-94e8-3cde325379d3","Type":"ContainerStarted","Data":"db137a0331482d653465efdf708f6380b34bde557c90a5b5d876d5fd07047a7a"} Jul 10 19:13:28.176518 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:28.176484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" event={"ID":"99040977-24c5-4c51-94e8-3cde325379d3","Type":"ContainerStarted","Data":"e10704331e9fb62bfe0a1198bc8ee88d08fae9f91ec2f318e9b1a655047b4634"} Jul 10 19:13:28.199826 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:28.199783 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6l4sb" podStartSLOduration=2.043397852 podStartE2EDuration="5.199768392s" totalImagesPullingTime="3.15637054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:13:28.197836017 +0000 UTC m=+345.899187121" watchObservedRunningTime="2026-07-10 19:13:28.199768392 +0000 UTC m=+345.901119498" Jul 10 19:13:43.609186 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.609106 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7"] Jul 10 19:13:43.614989 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.614967 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.633882 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.633864 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 19:13:43.634155 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.634141 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 19:13:43.648072 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.648053 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 19:13:43.663491 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.663470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.663564 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.663530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53d4574b-9bda-4e1d-9c70-98274a687bb7-manager-config\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.663601 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.663574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-metrics-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.663634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.663599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvc2f\" (UniqueName: \"kubernetes.io/projected/53d4574b-9bda-4e1d-9c70-98274a687bb7-kube-api-access-xvc2f\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.676015 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.675990 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7"] Jul 10 19:13:43.689754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.689736 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5v77z\"" Jul 10 19:13:43.764227 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.764196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.764359 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.764250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53d4574b-9bda-4e1d-9c70-98274a687bb7-manager-config\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.764359 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.764279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-metrics-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.764467 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.764446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvc2f\" (UniqueName: \"kubernetes.io/projected/53d4574b-9bda-4e1d-9c70-98274a687bb7-kube-api-access-xvc2f\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.765014 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.764995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/53d4574b-9bda-4e1d-9c70-98274a687bb7-manager-config\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.766707 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.766674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-metrics-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.766796 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.766743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53d4574b-9bda-4e1d-9c70-98274a687bb7-cert\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.782134 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.782115 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvc2f\" (UniqueName: \"kubernetes.io/projected/53d4574b-9bda-4e1d-9c70-98274a687bb7-kube-api-access-xvc2f\") pod \"lws-controller-manager-5d6cfdfcb9-vb9v7\" (UID: \"53d4574b-9bda-4e1d-9c70-98274a687bb7\") " pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:43.922948 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:43.922866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:44.065422 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.065391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7"] Jul 10 19:13:44.068190 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:13:44.068165 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d4574b_9bda_4e1d_9c70_98274a687bb7.slice/crio-099d75c6853f37f5eb9494fcccb2e8fa01cd203ddcb88d2e060d6c7f16dfc2e7 WatchSource:0}: Error finding container 099d75c6853f37f5eb9494fcccb2e8fa01cd203ddcb88d2e060d6c7f16dfc2e7: Status 404 returned error can't find the container with id 099d75c6853f37f5eb9494fcccb2e8fa01cd203ddcb88d2e060d6c7f16dfc2e7 Jul 10 19:13:44.235610 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.235575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" event={"ID":"53d4574b-9bda-4e1d-9c70-98274a687bb7","Type":"ContainerStarted","Data":"099d75c6853f37f5eb9494fcccb2e8fa01cd203ddcb88d2e060d6c7f16dfc2e7"} Jul 10 19:13:44.373031 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.373000 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p"] Jul 10 19:13:44.377963 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.377947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.382238 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.382215 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4cjwg\"" Jul 10 19:13:44.382984 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.382968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 19:13:44.382984 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.382978 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 19:13:44.385060 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.385041 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 19:13:44.389539 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.389522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 19:13:44.439423 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.439395 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p"] Jul 10 19:13:44.469065 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.469042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-tmp\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.469159 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.469068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrk2s\" (UniqueName: \"kubernetes.io/projected/20aafcfd-d8a0-4251-b937-ca3eff683248-kube-api-access-zrk2s\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.469159 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.469095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.469239 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.469191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-manifests\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.469239 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.469217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570080 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-manifests\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570080 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570080 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-tmp\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrk2s\" (UniqueName: \"kubernetes.io/projected/20aafcfd-d8a0-4251-b937-ca3eff683248-kube-api-access-zrk2s\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.570439 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.570406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-manifests\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.572333 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.572310 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20aafcfd-d8a0-4251-b937-ca3eff683248-tmp\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.572539 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.572522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.572619 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.572603 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20aafcfd-d8a0-4251-b937-ca3eff683248-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.578097 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.578076 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrk2s\" (UniqueName: \"kubernetes.io/projected/20aafcfd-d8a0-4251-b937-ca3eff683248-kube-api-access-zrk2s\") pod \"opendatahub-operator-controller-manager-64d686dc7f-sjw8p\" (UID: \"20aafcfd-d8a0-4251-b937-ca3eff683248\") " pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.688285 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.688243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:44.837388 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:44.837361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p"] Jul 10 19:13:44.840829 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:13:44.840796 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20aafcfd_d8a0_4251_b937_ca3eff683248.slice/crio-27ac75ffc624ef63c3f188657a473aba40cf833eed664d2e8c9f19fe0b97b3bf WatchSource:0}: Error finding container 27ac75ffc624ef63c3f188657a473aba40cf833eed664d2e8c9f19fe0b97b3bf: Status 404 returned error can't find the container with id 27ac75ffc624ef63c3f188657a473aba40cf833eed664d2e8c9f19fe0b97b3bf Jul 10 19:13:45.241433 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:45.241401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" event={"ID":"20aafcfd-d8a0-4251-b937-ca3eff683248","Type":"ContainerStarted","Data":"27ac75ffc624ef63c3f188657a473aba40cf833eed664d2e8c9f19fe0b97b3bf"} Jul 10 19:13:46.247625 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:46.247439 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" event={"ID":"53d4574b-9bda-4e1d-9c70-98274a687bb7","Type":"ContainerStarted","Data":"cd3c038681466fc6a7b598b436d8fb77a0579be847de731e3a187197339e4556"} Jul 10 19:13:46.247625 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:46.247556 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:13:46.267208 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:46.267152 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" podStartSLOduration=1.794078822 podStartE2EDuration="3.26713406s" totalImagesPullingTime="1.473055238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:13:46.266162974 +0000 UTC m=+363.967514079" watchObservedRunningTime="2026-07-10 19:13:46.26713406 +0000 UTC m=+363.968485169" Jul 10 19:13:49.260573 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:49.260535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" event={"ID":"20aafcfd-d8a0-4251-b937-ca3eff683248","Type":"ContainerStarted","Data":"e14e609984d64382fb11523e7a08cd9ad4a88a9c4f70e4c25dd4365d7ac01d79"} Jul 10 19:13:50.266233 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:50.266198 2559 generic.go:356] "Generic (PLEG): container finished" podID="20aafcfd-d8a0-4251-b937-ca3eff683248" containerID="e14e609984d64382fb11523e7a08cd9ad4a88a9c4f70e4c25dd4365d7ac01d79" exitCode=0 Jul 10 19:13:50.266648 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:50.266264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" event={"ID":"20aafcfd-d8a0-4251-b937-ca3eff683248","Type":"ContainerDied","Data":"e14e609984d64382fb11523e7a08cd9ad4a88a9c4f70e4c25dd4365d7ac01d79"} Jul 10 19:13:51.271763 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:51.271731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" event={"ID":"20aafcfd-d8a0-4251-b937-ca3eff683248","Type":"ContainerStarted","Data":"8b4dc468cd690a113a05bed803e4a8a3b523644c002a43ab65e83a8526da43f4"} Jul 10 19:13:51.272141 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:51.271860 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:13:51.295335 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:51.295288 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" podStartSLOduration=2.303601747 podStartE2EDuration="7.295272687s" totalImagesPullingTime="3.954500004s" totalInitContainerRuntime="1.037170936s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:13:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:13:51.293974136 +0000 UTC m=+368.995325220" watchObservedRunningTime="2026-07-10 19:13:51.295272687 +0000 UTC m=+368.996623790" Jul 10 19:13:57.254238 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:13:57.254204 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d6cfdfcb9-vb9v7" Jul 10 19:14:02.277335 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:02.277306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64d686dc7f-sjw8p" Jul 10 19:14:13.863912 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.863878 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:13.866910 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.866894 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.870115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.870088 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 19:14:13.870249 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.870120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 19:14:13.870532 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.870510 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 19:14:13.870678 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.870657 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5sw4m\"" Jul 10 19:14:13.889743 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.889719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:13.986707 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.986844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmn4\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.986844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.986844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.986844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.986844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.987007 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.987007 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:13.987007 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:13.986945 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088010 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.087977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmn4\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088143 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088469 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088469 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088597 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088659 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088641 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.088885 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.088862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.089057 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.089038 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.090528 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.090499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.090618 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.090545 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.101783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.101753 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmn4\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.102463 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.102446 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-skg2t\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.177844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.177767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:14.239238 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.239206 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b"] Jul 10 19:14:14.242959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.242936 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.246314 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.246288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 19:14:14.246531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.246515 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 19:14:14.246642 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.246629 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 19:14:14.246743 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.246685 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fmmdt\"" Jul 10 19:14:14.256527 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.256504 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b"] Jul 10 19:14:14.290131 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11e6f587-590f-48fb-83b3-867c920a22f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290337 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqbjv\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-kube-api-access-bqbjv\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290337 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290409 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.290444 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.290430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.324155 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.324133 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:14.326597 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:14:14.326573 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37805c74_2a76_478c_84d3_d474a5bee4e9.slice/crio-2d874e55b53995763887367fe38a13c87a0b746b9ec2744ff4abdaaf2f9b5602 WatchSource:0}: Error finding container 2d874e55b53995763887367fe38a13c87a0b746b9ec2744ff4abdaaf2f9b5602: Status 404 returned error can't find the container with id 2d874e55b53995763887367fe38a13c87a0b746b9ec2744ff4abdaaf2f9b5602 Jul 10 19:14:14.359635 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.359611 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" event={"ID":"37805c74-2a76-478c-84d3-d474a5bee4e9","Type":"ContainerStarted","Data":"2d874e55b53995763887367fe38a13c87a0b746b9ec2744ff4abdaaf2f9b5602"} Jul 10 19:14:14.390988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.390964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.390993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11e6f587-590f-48fb-83b3-867c920a22f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqbjv\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-kube-api-access-bqbjv\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391337 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.391852 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.391817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.393375 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.393345 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.393454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.393379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11e6f587-590f-48fb-83b3-867c920a22f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.393454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.393442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.393529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.393458 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11e6f587-590f-48fb-83b3-867c920a22f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.399498 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.399478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqbjv\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-kube-api-access-bqbjv\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.400089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.400071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11e6f587-590f-48fb-83b3-867c920a22f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2q89b\" (UID: \"11e6f587-590f-48fb-83b3-867c920a22f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.553968 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.553940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:14.698097 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:14.698066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b"] Jul 10 19:14:14.700990 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:14:14.700959 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e6f587_590f_48fb_83b3_867c920a22f2.slice/crio-59dcdd6b24ec9bd6d523f6737adea4ce71d42219daf7440b4a40953dbdcfdcd2 WatchSource:0}: Error finding container 59dcdd6b24ec9bd6d523f6737adea4ce71d42219daf7440b4a40953dbdcfdcd2: Status 404 returned error can't find the container with id 59dcdd6b24ec9bd6d523f6737adea4ce71d42219daf7440b4a40953dbdcfdcd2 Jul 10 19:14:15.365525 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:15.365486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" event={"ID":"11e6f587-590f-48fb-83b3-867c920a22f2","Type":"ContainerStarted","Data":"59dcdd6b24ec9bd6d523f6737adea4ce71d42219daf7440b4a40953dbdcfdcd2"} Jul 10 19:14:16.894922 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:16.894887 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:14:16.895183 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:16.894956 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:14:16.895183 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:16.894985 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:14:17.384308 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:17.384267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" event={"ID":"37805c74-2a76-478c-84d3-d474a5bee4e9","Type":"ContainerStarted","Data":"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603"} Jul 10 19:14:17.422383 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:17.422339 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" podStartSLOduration=1.8560776940000001 podStartE2EDuration="4.422322196s" totalImagesPullingTime="2.566244502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:14:17.420830074 +0000 UTC m=+395.122181180" watchObservedRunningTime="2026-07-10 19:14:17.422322196 +0000 UTC m=+395.123673300" Jul 10 19:14:18.178216 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:18.178183 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:18.179531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:18.179508 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jul 10 19:14:18.179648 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:18.179551 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jul 10 19:14:18.521768 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:18.521736 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:19.179131 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:19.179097 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jul 10 19:14:19.179512 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:19.179175 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jul 10 19:14:20.178534 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:20.178492 2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jul 10 19:14:20.178808 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:20.178565 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jul 10 19:14:20.396854 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:20.396818 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" containerID="cri-o://a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603" gracePeriod=30 Jul 10 19:14:25.864652 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:25.864614 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:14:25.865059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:25.864712 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:14:25.983058 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:25.983035 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:26.087817 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087739 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.087959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087837 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.087959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087885 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnmn4\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.087959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087921 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.087959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087943 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087966 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087979 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087999 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.087997 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088038 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088085 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo\") pod \"37805c74-2a76-478c-84d3-d474a5bee4e9\" (UID: \"37805c74-2a76-478c-84d3-d474a5bee4e9\") " Jul 10 19:14:26.088232 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088223 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088231 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088338 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37805c74-2a76-478c-84d3-d474a5bee4e9-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088363 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088376 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088402 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.088563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.088408 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:14:26.090185 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.090156 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:14:26.090330 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.090315 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:14:26.090439 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.090423 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:14:26.090520 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.090498 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4" (OuterVolumeSpecName: "kube-api-access-vnmn4") pod "37805c74-2a76-478c-84d3-d474a5bee4e9" (UID: "37805c74-2a76-478c-84d3-d474a5bee4e9"). InnerVolumeSpecName "kube-api-access-vnmn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:14:26.189102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.189078 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.189102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.189097 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.189102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.189105 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37805c74-2a76-478c-84d3-d474a5bee4e9-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.189268 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.189131 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37805c74-2a76-478c-84d3-d474a5bee4e9-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.189268 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.189141 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnmn4\" (UniqueName: \"kubernetes.io/projected/37805c74-2a76-478c-84d3-d474a5bee4e9-kube-api-access-vnmn4\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:14:26.423194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.423105 2559 generic.go:356] "Generic (PLEG): container finished" podID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerID="a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603" exitCode=0 Jul 10 19:14:26.423194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.423148 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" Jul 10 19:14:26.423424 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.423192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" event={"ID":"37805c74-2a76-478c-84d3-d474a5bee4e9","Type":"ContainerDied","Data":"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603"} Jul 10 19:14:26.423424 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.423255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t" event={"ID":"37805c74-2a76-478c-84d3-d474a5bee4e9","Type":"ContainerDied","Data":"2d874e55b53995763887367fe38a13c87a0b746b9ec2744ff4abdaaf2f9b5602"} Jul 10 19:14:26.423424 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.423288 2559 scope.go:117] "RemoveContainer" containerID="a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603" Jul 10 19:14:26.425081 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.425052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" event={"ID":"11e6f587-590f-48fb-83b3-867c920a22f2","Type":"ContainerStarted","Data":"28f58a03beeac3117cb2d7000290527c3e5c35f323c61e328a140c812634de19"} Jul 10 19:14:26.425297 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.425277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:14:26.426866 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.426807 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2q89b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 19:14:26.426967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.426857 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" podUID="11e6f587-590f-48fb-83b3-867c920a22f2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 19:14:26.433061 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.433040 2559 scope.go:117] "RemoveContainer" containerID="a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603" Jul 10 19:14:26.433346 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:14:26.433322 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603\": container with ID starting with a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603 not found: ID does not exist" containerID="a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603" Jul 10 19:14:26.433412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.433354 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603"} err="failed to get container status \"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603\": rpc error: code = NotFound desc = could not find container \"a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603\": container with ID starting with a16fb19875f9c81d7ec20f4385aa9995f2de8169fe684a1271650466b84de603 not found: ID does not exist" Jul 10 19:14:26.450619 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.450574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" podStartSLOduration=1.289304902 podStartE2EDuration="12.450558815s" totalImagesPullingTime="11.161253913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:14:26.448931699 +0000 UTC m=+404.150282803" watchObservedRunningTime="2026-07-10 19:14:26.450558815 +0000 UTC m=+404.151909919" Jul 10 19:14:26.465595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.465572 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:26.468800 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.468779 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-skg2t"] Jul 10 19:14:26.909128 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:26.909094 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" path="/var/lib/kubelet/pods/37805c74-2a76-478c-84d3-d474a5bee4e9/volumes" Jul 10 19:14:27.430901 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:14:27.430878 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2q89b" Jul 10 19:16:14.849776 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.849737 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:16:14.850364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.850126 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" Jul 10 19:16:14.850364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.850145 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" Jul 10 19:16:14.850364 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.850218 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="37805c74-2a76-478c-84d3-d474a5bee4e9" containerName="istio-proxy" Jul 10 19:16:14.853071 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.853049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:14.855777 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.855754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cmfwj\"" Jul 10 19:16:14.855985 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.855972 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 19:16:14.856787 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.856771 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 19:16:14.856988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.856970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 19:16:14.867079 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.867059 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:16:14.897425 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.897396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2nsr\" (UniqueName: \"kubernetes.io/projected/14db0466-efcd-4e1a-8756-de532ecec466-kube-api-access-b2nsr\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:14.897550 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.897432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14db0466-efcd-4e1a-8756-de532ecec466-config-file\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:14.909623 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.909600 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:16:14.998373 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.998349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2nsr\" (UniqueName: \"kubernetes.io/projected/14db0466-efcd-4e1a-8756-de532ecec466-kube-api-access-b2nsr\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:14.998501 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.998381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14db0466-efcd-4e1a-8756-de532ecec466-config-file\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:14.998959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:14.998942 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14db0466-efcd-4e1a-8756-de532ecec466-config-file\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:15.010036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:15.010017 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2nsr\" (UniqueName: \"kubernetes.io/projected/14db0466-efcd-4e1a-8756-de532ecec466-kube-api-access-b2nsr\") pod \"limitador-limitador-69574b596d-r7ttl\" (UID: \"14db0466-efcd-4e1a-8756-de532ecec466\") " pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:15.162574 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:15.162499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:15.316514 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:15.316486 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:16:15.319764 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:16:15.319739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14db0466_efcd_4e1a_8756_de532ecec466.slice/crio-fe89e84e3d772b8fbb2597d1bccb20267dd0b063889046e7f814e3b7464e9093 WatchSource:0}: Error finding container fe89e84e3d772b8fbb2597d1bccb20267dd0b063889046e7f814e3b7464e9093: Status 404 returned error can't find the container with id fe89e84e3d772b8fbb2597d1bccb20267dd0b063889046e7f814e3b7464e9093 Jul 10 19:16:15.853056 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:15.853025 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" event={"ID":"14db0466-efcd-4e1a-8756-de532ecec466","Type":"ContainerStarted","Data":"fe89e84e3d772b8fbb2597d1bccb20267dd0b063889046e7f814e3b7464e9093"} Jul 10 19:16:19.872746 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:19.872710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" event={"ID":"14db0466-efcd-4e1a-8756-de532ecec466","Type":"ContainerStarted","Data":"0140488e0122f300405e320d16732897b3279542b46d0fe8e54312bd51534adb"} Jul 10 19:16:19.873128 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:19.872825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:16:19.890759 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:19.890710 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" podStartSLOduration=1.909896146 podStartE2EDuration="5.89067445s" totalImagesPullingTime="3.980778304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:16:19.889985545 +0000 UTC m=+517.591336659" watchObservedRunningTime="2026-07-10 19:16:19.89067445 +0000 UTC m=+517.592025555" Jul 10 19:16:30.879093 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:16:30.879059 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-r7ttl" Jul 10 19:17:28.396175 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:17:28.396139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:17:42.753641 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:17:42.753616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:17:42.754156 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:17:42.753972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:18:06.886289 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:18:06.886202 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:18:25.881964 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:18:25.881925 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:18:56.170506 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:18:56.170467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:19:11.262258 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:11.262219 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:19:26.675151 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.675122 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx"] Jul 10 19:19:26.678298 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.678277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.682559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.682345 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 19:19:26.682559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.682370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 19:19:26.682559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.682398 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 19:19:26.682559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.682346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mmzcw\"" Jul 10 19:19:26.689802 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.689782 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx"] Jul 10 19:19:26.769967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.769942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7f60fe-946b-4dc3-8384-7fba313edaee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.770114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.769990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.770114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.770054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvsbr\" (UniqueName: \"kubernetes.io/projected/bb7f60fe-946b-4dc3-8384-7fba313edaee-kube-api-access-jvsbr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.770114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.770096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.770246 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.770118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.770246 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.770137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871230 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871230 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871411 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7f60fe-946b-4dc3-8384-7fba313edaee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871411 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871487 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvsbr\" (UniqueName: \"kubernetes.io/projected/bb7f60fe-946b-4dc3-8384-7fba313edaee-kube-api-access-jvsbr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871527 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871610 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871593 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871661 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871638 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.871742 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.871675 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.873581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.873561 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb7f60fe-946b-4dc3-8384-7fba313edaee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.873891 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.873871 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb7f60fe-946b-4dc3-8384-7fba313edaee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.879032 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.879016 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvsbr\" (UniqueName: \"kubernetes.io/projected/bb7f60fe-946b-4dc3-8384-7fba313edaee-kube-api-access-jvsbr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7svrx\" (UID: \"bb7f60fe-946b-4dc3-8384-7fba313edaee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:26.988860 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:26.988831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:27.117022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:27.117000 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx"] Jul 10 19:19:27.119328 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:19:27.119299 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7f60fe_946b_4dc3_8384_7fba313edaee.slice/crio-c2ea3c3ed454f09cac752a101f1acd6285662a8cf4e0e362bcb12f6d6c5610e6 WatchSource:0}: Error finding container c2ea3c3ed454f09cac752a101f1acd6285662a8cf4e0e362bcb12f6d6c5610e6: Status 404 returned error can't find the container with id c2ea3c3ed454f09cac752a101f1acd6285662a8cf4e0e362bcb12f6d6c5610e6 Jul 10 19:19:27.120712 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:27.120681 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 19:19:27.621519 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:27.621440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" event={"ID":"bb7f60fe-946b-4dc3-8384-7fba313edaee","Type":"ContainerStarted","Data":"c2ea3c3ed454f09cac752a101f1acd6285662a8cf4e0e362bcb12f6d6c5610e6"} Jul 10 19:19:28.366389 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:28.366357 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:19:28.627858 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:28.627821 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" event={"ID":"bb7f60fe-946b-4dc3-8384-7fba313edaee","Type":"ContainerStarted","Data":"7c165a635dd81c8b80261d766435e23d998af81a347d41ce5b15d7df337dafee"} Jul 10 19:19:28.644949 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:28.644900 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" podStartSLOduration=1.637201369 podStartE2EDuration="2.644882981s" totalImagesPullingTime="1.007681612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:19:28.643813029 +0000 UTC m=+706.345164148" watchObservedRunningTime="2026-07-10 19:19:28.644882981 +0000 UTC m=+706.346234120" Jul 10 19:19:36.989038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:36.988962 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:36.989038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:36.989018 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:37.000998 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:37.000973 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:37.677548 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:37.677522 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7svrx" Jul 10 19:19:41.770907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:19:41.770876 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:00.168006 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:00.167970 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:10.064316 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:10.064241 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:15.487551 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:15.487516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:25.365818 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:25.365787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:30.766118 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:30.766087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:21:40.671754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:21:40.671715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:22:08.682265 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:08.682231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:22:18.278321 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:18.278289 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:22:40.270556 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:40.270480 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:22:42.778425 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:42.778393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:22:42.778857 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:42.778824 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:22:49.272931 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:49.272897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:22:56.273356 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:22:56.273321 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:03.781323 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:03.781286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:10.570607 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:10.570571 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:18.667583 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:18.667544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:28.679123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:28.679087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:36.875783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:36.875749 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:48.874233 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:48.874202 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:23:54.581570 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:23:54.581527 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:24:02.478572 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:24:02.478535 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:24:11.773524 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:24:11.773441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:24:24.380730 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:24:24.380700 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:24:31.682132 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:24:31.682089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:24:56.378302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:24:56.378269 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:25:06.273021 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:25:06.272986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:25:23.587398 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:25:23.587356 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:25:31.168809 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:25:31.168776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:25:42.875482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:25:42.875410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:25:51.273380 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:25:51.273345 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:26:00.476358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:26:00.476318 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:27:42.801704 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:27:42.801666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:27:42.802706 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:27:42.802674 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:27:50.879279 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:27:50.879242 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:27:57.678523 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:27:57.678487 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:11.120192 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:11.120153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:18.468854 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:18.468820 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:26.575015 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:26.574982 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:31.672975 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:31.672934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:36.967201 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:36.967114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:46.084096 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:46.084063 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:28:51.368540 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:28:51.368506 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:01.376025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:01.375980 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:06.579315 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:06.579279 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:16.679651 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:16.679618 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:23.543893 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:23.543863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:33.775161 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:33.775126 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:29:56.676957 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:29:56.676920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:05.073058 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:05.072980 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:14.777053 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:14.777016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:23.580064 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:23.580026 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:30.684620 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:30.684580 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:41.103952 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:41.103921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:49.990222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:49.990187 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:30:57.603730 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:30:57.603680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:06.990754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:06.990719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:14.205559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:14.205521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:32.083791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:32.083753 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:39.073418 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:39.073328 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:50.581077 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:50.581044 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:31:57.679400 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:31:57.679353 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:04.883944 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:04.883911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:11.172746 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:11.172715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:18.172746 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:18.172712 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:27.572586 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:27.572552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:34.635853 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:34.635818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:42.822656 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:42.822626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:32:42.824319 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:42.824297 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:32:44.878575 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:44.878544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:32:54.770247 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:32:54.770211 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:05.969605 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:05.969517 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:12.982804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:12.982763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:22.980783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:22.980750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:31.470436 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:31.470394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:39.403474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.403443 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:39.406644 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.406618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.409092 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.409070 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f5c7829e-openshift-default-dockercfg-rlzp2\"" Jul 10 19:33:39.430614 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.430593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:39.539416 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539416 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzl7b\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539615 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539807 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.539807 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.539668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640477 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640771 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzl7b\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640771 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640771 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640651 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640771 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.640963 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.640933 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.641056 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.641036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.641258 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.641218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.641258 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.641234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.641410 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.641343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.642882 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.642865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.643162 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.643146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.648419 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.648393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzl7b\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.648939 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.648920 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token\") pod \"e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.718315 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.718291 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:39.850110 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.850087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:39.852623 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:33:39.852590 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d86d80b_ddaa_4fa1_881d_be799b67724a.slice/crio-bd45df85145ac91e9ef5402f6cdbd3825362cbf5ba717769e06adbad60596a4d WatchSource:0}: Error finding container bd45df85145ac91e9ef5402f6cdbd3825362cbf5ba717769e06adbad60596a4d: Status 404 returned error can't find the container with id bd45df85145ac91e9ef5402f6cdbd3825362cbf5ba717769e06adbad60596a4d Jul 10 19:33:39.854608 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.854578 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:39.854686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.854655 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:39.854760 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:39.854684 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:40.038595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:40.038501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" event={"ID":"6d86d80b-ddaa-4fa1-881d-be799b67724a","Type":"ContainerStarted","Data":"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455"} Jul 10 19:33:40.038595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:40.038573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" event={"ID":"6d86d80b-ddaa-4fa1-881d-be799b67724a","Type":"ContainerStarted","Data":"bd45df85145ac91e9ef5402f6cdbd3825362cbf5ba717769e06adbad60596a4d"} Jul 10 19:33:40.058538 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:40.058262 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" podStartSLOduration=1.058241525 podStartE2EDuration="1.058241525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:33:40.056041723 +0000 UTC m=+1557.757392827" watchObservedRunningTime="2026-07-10 19:33:40.058241525 +0000 UTC m=+1557.759592630" Jul 10 19:33:40.718673 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:40.718640 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:40.723287 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:40.723264 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:41.043920 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:41.043836 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:41.044801 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:41.044780 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:43.075356 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:43.075325 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:45.728673 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:45.728641 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:45.729059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:45.728818 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" podUID="6d86d80b-ddaa-4fa1-881d-be799b67724a" containerName="istio-proxy" containerID="cri-o://50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455" gracePeriod=30 Jul 10 19:33:50.465669 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:50.465621 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:33:51.566567 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.566531 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:33:51.570490 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.570467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.572875 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.572853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0f19f196-openshift-default-dockercfg-dxgpz\"" Jul 10 19:33:51.582055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.582029 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:33:51.752262 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgp6\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752753 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752753 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.752753 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.752524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.853939 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.853845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.853939 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.853903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.853944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.853988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgp6\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854440 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854440 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854538 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854462 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854538 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854483 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854801 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.854898 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.854854 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.856327 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.856304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.856787 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.856770 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.861880 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.861859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.862089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.862068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgp6\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6\") pod \"e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:51.881984 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:51.881955 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:52.021328 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.021302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:33:52.023458 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:33:52.023426 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960dc85b_ba62_42c4_bf81_891229c940e5.slice/crio-0fbde5cc7e3359033636d8414753068f18f44ba160e5d0ca32b59bab5b2e4a4e WatchSource:0}: Error finding container 0fbde5cc7e3359033636d8414753068f18f44ba160e5d0ca32b59bab5b2e4a4e: Status 404 returned error can't find the container with id 0fbde5cc7e3359033636d8414753068f18f44ba160e5d0ca32b59bab5b2e4a4e Jul 10 19:33:52.025662 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.025625 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:52.025766 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.025727 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:52.025816 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.025778 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:33:52.099382 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.099351 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" event={"ID":"960dc85b-ba62-42c4-bf81-891229c940e5","Type":"ContainerStarted","Data":"71b236311b18376414b5ae1e03e603ad771eeaeb60fdea317c51c422cf6ed7aa"} Jul 10 19:33:52.099482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.099405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" event={"ID":"960dc85b-ba62-42c4-bf81-891229c940e5","Type":"ContainerStarted","Data":"0fbde5cc7e3359033636d8414753068f18f44ba160e5d0ca32b59bab5b2e4a4e"} Jul 10 19:33:52.118454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.118393 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" podStartSLOduration=1.118371599 podStartE2EDuration="1.118371599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:33:52.115633741 +0000 UTC m=+1569.816984867" watchObservedRunningTime="2026-07-10 19:33:52.118371599 +0000 UTC m=+1569.819722708" Jul 10 19:33:52.374490 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.374440 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:52.560421 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560386 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560432 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560461 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzl7b\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560489 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560513 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560590 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560619 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560644 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket\") pod \"6d86d80b-ddaa-4fa1-881d-be799b67724a\" (UID: \"6d86d80b-ddaa-4fa1-881d-be799b67724a\") " Jul 10 19:33:52.560929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560682 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:33:52.560929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560768 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:33:52.560929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560905 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:33:52.561157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.560975 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:33:52.561157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.561014 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:33:52.561157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.561135 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.561312 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.561161 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.561312 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.561190 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.562802 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.562773 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:33:52.562921 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.562847 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:33:52.562921 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.562849 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:33:52.562921 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.562846 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b" (OuterVolumeSpecName: "kube-api-access-qzl7b") pod "6d86d80b-ddaa-4fa1-881d-be799b67724a" (UID: "6d86d80b-ddaa-4fa1-881d-be799b67724a"). InnerVolumeSpecName "kube-api-access-qzl7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662394 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzl7b\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-kube-api-access-qzl7b\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662425 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662439 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662451 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d86d80b-ddaa-4fa1-881d-be799b67724a-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662462 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d86d80b-ddaa-4fa1-881d-be799b67724a-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.662474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.662473 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d86d80b-ddaa-4fa1-881d-be799b67724a-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:33:52.882705 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:52.882661 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:53.104488 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.104448 2559 generic.go:356] "Generic (PLEG): container finished" podID="6d86d80b-ddaa-4fa1-881d-be799b67724a" containerID="50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455" exitCode=0 Jul 10 19:33:53.104645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.104500 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" Jul 10 19:33:53.104645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.104531 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" event={"ID":"6d86d80b-ddaa-4fa1-881d-be799b67724a","Type":"ContainerDied","Data":"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455"} Jul 10 19:33:53.104645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.104582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc" event={"ID":"6d86d80b-ddaa-4fa1-881d-be799b67724a","Type":"ContainerDied","Data":"bd45df85145ac91e9ef5402f6cdbd3825362cbf5ba717769e06adbad60596a4d"} Jul 10 19:33:53.104645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.104608 2559 scope.go:117] "RemoveContainer" containerID="50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455" Jul 10 19:33:53.112778 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.112757 2559 scope.go:117] "RemoveContainer" containerID="50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455" Jul 10 19:33:53.113021 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:33:53.113002 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455\": container with ID starting with 50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455 not found: ID does not exist" containerID="50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455" Jul 10 19:33:53.113112 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.113028 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455"} err="failed to get container status \"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455\": rpc error: code = NotFound desc = could not find container \"50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455\": container with ID starting with 50cd867106ba7c8895a8762bb18bf84b81bc3a495f85af7a9c6cce42ab840455 not found: ID does not exist" Jul 10 19:33:53.128887 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.124777 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:53.132810 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.132781 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f5c7829e-openshift-default-8bfcbc7b5-8khdc"] Jul 10 19:33:53.886849 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:53.886820 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:54.110227 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:54.110199 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:54.111143 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:54.111124 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:33:54.909645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:54.909615 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d86d80b-ddaa-4fa1-881d-be799b67724a" path="/var/lib/kubelet/pods/6d86d80b-ddaa-4fa1-881d-be799b67724a/volumes" Jul 10 19:33:57.970067 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:33:57.970022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:34:02.972735 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:02.972685 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:34:03.792793 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:03.792754 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:34:03.792992 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:03.792963 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" podUID="960dc85b-ba62-42c4-bf81-891229c940e5" containerName="istio-proxy" containerID="cri-o://71b236311b18376414b5ae1e03e603ad771eeaeb60fdea317c51c422cf6ed7aa" gracePeriod=30 Jul 10 19:34:04.156749 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.156719 2559 generic.go:356] "Generic (PLEG): container finished" podID="960dc85b-ba62-42c4-bf81-891229c940e5" containerID="71b236311b18376414b5ae1e03e603ad771eeaeb60fdea317c51c422cf6ed7aa" exitCode=0 Jul 10 19:34:04.157124 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.156764 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" event={"ID":"960dc85b-ba62-42c4-bf81-891229c940e5","Type":"ContainerDied","Data":"71b236311b18376414b5ae1e03e603ad771eeaeb60fdea317c51c422cf6ed7aa"} Jul 10 19:34:04.234959 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.234931 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256193 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256243 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256281 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256307 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256332 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256412 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256368 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256432 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256454 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256479 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djgp6\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6\") pod \"960dc85b-ba62-42c4-bf81-891229c940e5\" (UID: \"960dc85b-ba62-42c4-bf81-891229c940e5\") " Jul 10 19:34:04.256851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256743 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:04.256851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.256749 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:04.257413 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.257151 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:04.257413 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.257223 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:04.257413 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.257368 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:34:04.258901 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.258873 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:34:04.259207 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.259166 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:34:04.259306 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.259206 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6" (OuterVolumeSpecName: "kube-api-access-djgp6") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "kube-api-access-djgp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:34:04.259306 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.259266 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "960dc85b-ba62-42c4-bf81-891229c940e5" (UID: "960dc85b-ba62-42c4-bf81-891229c940e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:04.357039 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357017 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357039 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357039 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357048 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357058 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357066 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357073 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960dc85b-ba62-42c4-bf81-891229c940e5-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357082 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960dc85b-ba62-42c4-bf81-891229c940e5-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357089 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djgp6\" (UniqueName: \"kubernetes.io/projected/960dc85b-ba62-42c4-bf81-891229c940e5-kube-api-access-djgp6\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:04.357191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:04.357098 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960dc85b-ba62-42c4-bf81-891229c940e5-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:05.162186 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:05.162154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" event={"ID":"960dc85b-ba62-42c4-bf81-891229c940e5","Type":"ContainerDied","Data":"0fbde5cc7e3359033636d8414753068f18f44ba160e5d0ca32b59bab5b2e4a4e"} Jul 10 19:34:05.162640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:05.162206 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k" Jul 10 19:34:05.162640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:05.162238 2559 scope.go:117] "RemoveContainer" containerID="71b236311b18376414b5ae1e03e603ad771eeaeb60fdea317c51c422cf6ed7aa" Jul 10 19:34:05.181763 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:05.181740 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:34:05.185003 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:05.184982 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0f19f196-openshift-default-67bddcdfff-vsm4k"] Jul 10 19:34:06.909078 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:06.909045 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960dc85b-ba62-42c4-bf81-891229c940e5" path="/var/lib/kubelet/pods/960dc85b-ba62-42c4-bf81-891229c940e5/volumes" Jul 10 19:34:09.856844 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.856815 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857103 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d86d80b-ddaa-4fa1-881d-be799b67724a" containerName="istio-proxy" Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857114 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d86d80b-ddaa-4fa1-881d-be799b67724a" containerName="istio-proxy" Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857123 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960dc85b-ba62-42c4-bf81-891229c940e5" containerName="istio-proxy" Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857128 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="960dc85b-ba62-42c4-bf81-891229c940e5" containerName="istio-proxy" Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857180 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d86d80b-ddaa-4fa1-881d-be799b67724a" containerName="istio-proxy" Jul 10 19:34:09.857194 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.857187 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="960dc85b-ba62-42c4-bf81-891229c940e5" containerName="istio-proxy" Jul 10 19:34:09.859900 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.859877 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.862264 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.862244 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-57caaf74-openshift-default-dockercfg-c6m6b\"" Jul 10 19:34:09.874201 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.874180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:09.899852 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.899818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.899980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.899863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.899980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.899938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900096 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900020 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900096 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900248 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvrl\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:09.900248 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:09.900208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001140 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001140 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001363 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvrl\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001363 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001478 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001478 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001478 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001626 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001626 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001626 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001611 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001802 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001853 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.001853 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.001842 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.002117 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.002098 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.003408 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.003390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.004012 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.003996 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.008652 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.008631 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.008889 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.008872 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvrl\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl\") pod \"e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.171525 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.171442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:10.299062 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.299039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:10.301967 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:34:10.301934 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b68e36b_b93c_4614_b40b_10dbb39eb8af.slice/crio-da51a0b07713a7fd2eb49d643bead67326021d204559717029e21b32cb896cff WatchSource:0}: Error finding container da51a0b07713a7fd2eb49d643bead67326021d204559717029e21b32cb896cff: Status 404 returned error can't find the container with id da51a0b07713a7fd2eb49d643bead67326021d204559717029e21b32cb896cff Jul 10 19:34:10.303904 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.303872 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:34:10.303972 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.303939 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:34:10.303972 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:10.303967 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:34:11.190457 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:11.190423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" event={"ID":"9b68e36b-b93c-4614-b40b-10dbb39eb8af","Type":"ContainerStarted","Data":"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b"} Jul 10 19:34:11.190921 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:11.190489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" event={"ID":"9b68e36b-b93c-4614-b40b-10dbb39eb8af","Type":"ContainerStarted","Data":"da51a0b07713a7fd2eb49d643bead67326021d204559717029e21b32cb896cff"} Jul 10 19:34:11.214415 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:11.214370 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" podStartSLOduration=2.214356336 podStartE2EDuration="2.214356336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:34:11.21293688 +0000 UTC m=+1588.914287982" watchObservedRunningTime="2026-07-10 19:34:11.214356336 +0000 UTC m=+1588.915707440" Jul 10 19:34:12.172251 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:12.172215 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:12.176816 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:12.176795 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:12.194178 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:12.194151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:12.194807 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:12.194789 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:13.166566 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:13.166531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:34:15.624361 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:15.624321 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:15.624856 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:15.624535 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" podUID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" containerName="istio-proxy" containerID="cri-o://a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b" gracePeriod=30 Jul 10 19:34:20.569155 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:20.569121 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:34:22.869018 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.868996 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:22.924022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.923956 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvrl\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.923991 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924045 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924069 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924097 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924139 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924166 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924191 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924484 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token\") pod \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\" (UID: \"9b68e36b-b93c-4614-b40b-10dbb39eb8af\") " Jul 10 19:34:22.924484 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924376 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:22.924484 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924394 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:22.924484 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924465 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:34:22.924686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924514 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:22.924686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924534 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:22.924686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924641 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:22.924686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.924672 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:22.926234 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.926205 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl" (OuterVolumeSpecName: "kube-api-access-tfvrl") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "kube-api-access-tfvrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:34:22.926350 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.926309 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:34:22.926350 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.926322 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:34:22.926429 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:22.926372 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b68e36b-b93c-4614-b40b-10dbb39eb8af" (UID: "9b68e36b-b93c-4614-b40b-10dbb39eb8af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:34:23.025457 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025424 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025457 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025455 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025649 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025468 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025649 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025482 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025649 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025494 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvrl\" (UniqueName: \"kubernetes.io/projected/9b68e36b-b93c-4614-b40b-10dbb39eb8af-kube-api-access-tfvrl\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025649 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025507 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.025649 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.025518 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b68e36b-b93c-4614-b40b-10dbb39eb8af-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:34:23.242482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.242448 2559 generic.go:356] "Generic (PLEG): container finished" podID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" containerID="a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b" exitCode=0 Jul 10 19:34:23.242633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.242506 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" Jul 10 19:34:23.242633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.242539 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" event={"ID":"9b68e36b-b93c-4614-b40b-10dbb39eb8af","Type":"ContainerDied","Data":"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b"} Jul 10 19:34:23.242633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.242595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw" event={"ID":"9b68e36b-b93c-4614-b40b-10dbb39eb8af","Type":"ContainerDied","Data":"da51a0b07713a7fd2eb49d643bead67326021d204559717029e21b32cb896cff"} Jul 10 19:34:23.242633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.242625 2559 scope.go:117] "RemoveContainer" containerID="a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b" Jul 10 19:34:23.251269 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.251255 2559 scope.go:117] "RemoveContainer" containerID="a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b" Jul 10 19:34:23.251511 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:34:23.251492 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b\": container with ID starting with a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b not found: ID does not exist" containerID="a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b" Jul 10 19:34:23.251574 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.251517 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b"} err="failed to get container status \"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b\": rpc error: code = NotFound desc = could not find container \"a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b\": container with ID starting with a08796a1b081731c571aad79005db73496f36918eddf49b1649e2adc723aba0b not found: ID does not exist" Jul 10 19:34:23.265471 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.265449 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:23.271702 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:23.271666 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-57caaf74-openshift-default-75b75677cf-xgqcw"] Jul 10 19:34:24.909762 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:34:24.909728 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" path="/var/lib/kubelet/pods/9b68e36b-b93c-4614-b40b-10dbb39eb8af/volumes" Jul 10 19:35:42.377736 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:42.377679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:35:48.267445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:48.267402 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:35:53.770674 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:53.770637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:35:55.928911 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.928871 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:35:55.929366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.929297 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" containerName="istio-proxy" Jul 10 19:35:55.929366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.929315 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" containerName="istio-proxy" Jul 10 19:35:55.929479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.929414 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b68e36b-b93c-4614-b40b-10dbb39eb8af" containerName="istio-proxy" Jul 10 19:35:55.931473 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.931449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:55.933848 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.933822 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8c3d0966-openshift-default-dockercfg-qcm7n\"" Jul 10 19:35:55.949733 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:55.949666 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:35:56.049487 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049727 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049727 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwndx\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.049881 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.049808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.150833 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.150799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.150994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.150840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.150994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.150857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.150994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.150883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.150999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwndx\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151428 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151227 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151428 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151428 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151421 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151606 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.151668 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.151648 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.153297 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.153274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.153414 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.153309 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.158244 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.158214 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.158477 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.158460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwndx\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx\") pod \"e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.242598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.242570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:56.368472 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.368311 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:35:56.371223 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:35:56.371194 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bf3c5b_7c44_4854_8f4b_6ced386ef07e.slice/crio-31b7c063ac986ebb8952bdd83af96f18f0bedeeec9ae8630a3ad72da691cf3e1 WatchSource:0}: Error finding container 31b7c063ac986ebb8952bdd83af96f18f0bedeeec9ae8630a3ad72da691cf3e1: Status 404 returned error can't find the container with id 31b7c063ac986ebb8952bdd83af96f18f0bedeeec9ae8630a3ad72da691cf3e1 Jul 10 19:35:56.373215 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.373182 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:35:56.373296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.373246 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:35:56.373296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.373279 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:35:56.620320 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.620245 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerStarted","Data":"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47"} Jul 10 19:35:56.620320 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.620302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerStarted","Data":"31b7c063ac986ebb8952bdd83af96f18f0bedeeec9ae8630a3ad72da691cf3e1"} Jul 10 19:35:56.638210 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:56.638127 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podStartSLOduration=1.6381063820000001 podStartE2EDuration="1.638106382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:35:56.637315873 +0000 UTC m=+1694.338666977" watchObservedRunningTime="2026-07-10 19:35:56.638106382 +0000 UTC m=+1694.339457488" Jul 10 19:35:57.243773 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:57.243730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:57.248601 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:57.248577 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:57.624821 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:57.624730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:35:57.625663 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:35:57.625645 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:36:01.864592 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:01.864557 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:36:11.685369 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.685270 2559 generic.go:356] "Generic (PLEG): container finished" podID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerID="1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47" exitCode=0 Jul 10 19:36:11.685369 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.685350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerDied","Data":"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47"} Jul 10 19:36:11.685794 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.685715 2559 scope.go:117] "RemoveContainer" containerID="1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47" Jul 10 19:36:11.686710 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.686669 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:11.686783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.686767 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:11.686823 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:11.686805 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:12.624681 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:12.624646 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:36:12.667900 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:12.667861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:36:12.692783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:12.692747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerStarted","Data":"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998"} Jul 10 19:36:13.242998 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:13.242968 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:36:13.244025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:13.243995 2559 patch_prober.go:28] interesting pod/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 10 19:36:13.244145 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:13.244057 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 10 19:36:14.242982 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:14.242950 2559 patch_prober.go:28] interesting pod/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 10 19:36:14.243362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:14.243005 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 10 19:36:15.242884 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:15.242850 2559 patch_prober.go:28] interesting pod/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 10 19:36:15.243044 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:15.242907 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 10 19:36:16.243745 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:16.243686 2559 patch_prober.go:28] interesting pod/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 10 19:36:16.244138 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:16.243777 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 10 19:36:16.675379 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:16.675286 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:36:16.675596 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:16.675541 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" containerID="cri-o://3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998" gracePeriod=30 Jul 10 19:36:23.520967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.520941 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:36:23.560583 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560516 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwndx\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560583 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560564 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560590 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560652 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560712 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560755 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560999 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.560999 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560806 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:36:23.560999 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.560829 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy\") pod \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\" (UID: \"35bf3c5b-7c44-4854-8f4b-6ced386ef07e\") " Jul 10 19:36:23.561147 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.561049 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data" (OuterVolumeSpecName: "istio-data") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:36:23.561147 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.561042 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:36:23.561147 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.561073 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.561147 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.561121 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:36:23.561310 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.561275 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:36:23.562941 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.562912 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:36:23.563008 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.562922 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token" (OuterVolumeSpecName: "istio-token") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:36:23.563125 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.563106 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx" (OuterVolumeSpecName: "kube-api-access-bwndx") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "kube-api-access-bwndx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:36:23.563174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.563125 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35bf3c5b-7c44-4854-8f4b-6ced386ef07e" (UID: "35bf3c5b-7c44-4854-8f4b-6ced386ef07e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:36:23.661793 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661748 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.661793 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661786 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.661793 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661800 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.662029 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661813 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.662029 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661825 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.662029 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661835 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.662029 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661847 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwndx\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-kube-api-access-bwndx\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.662029 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.661860 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35bf3c5b-7c44-4854-8f4b-6ced386ef07e-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:36:23.740334 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.740293 2559 generic.go:356] "Generic (PLEG): container finished" podID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerID="3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998" exitCode=0 Jul 10 19:36:23.740492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.740347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerDied","Data":"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998"} Jul 10 19:36:23.740492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.740355 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" Jul 10 19:36:23.740492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.740403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx" event={"ID":"35bf3c5b-7c44-4854-8f4b-6ced386ef07e","Type":"ContainerDied","Data":"31b7c063ac986ebb8952bdd83af96f18f0bedeeec9ae8630a3ad72da691cf3e1"} Jul 10 19:36:23.740492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.740433 2559 scope.go:117] "RemoveContainer" containerID="3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998" Jul 10 19:36:23.749291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.749275 2559 scope.go:117] "RemoveContainer" containerID="1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47" Jul 10 19:36:23.756497 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.756480 2559 scope.go:117] "RemoveContainer" containerID="3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998" Jul 10 19:36:23.756757 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:36:23.756732 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998\": container with ID starting with 3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998 not found: ID does not exist" containerID="3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998" Jul 10 19:36:23.756868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.756767 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998"} err="failed to get container status \"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998\": rpc error: code = NotFound desc = could not find container \"3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998\": container with ID starting with 3538742d36ce6b770df0481da36d0768f99e3e3dddc9e9d5cbbc9cac0b341998 not found: ID does not exist" Jul 10 19:36:23.756868 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.756790 2559 scope.go:117] "RemoveContainer" containerID="1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47" Jul 10 19:36:23.757047 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:36:23.757029 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47\": container with ID starting with 1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47 not found: ID does not exist" containerID="1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47" Jul 10 19:36:23.757096 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.757054 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47"} err="failed to get container status \"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47\": rpc error: code = NotFound desc = could not find container \"1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47\": container with ID starting with 1c034f3fb9fa2f3be4ee224fc034855e5b6e80bcde2cfac466249d5e4d080d47 not found: ID does not exist" Jul 10 19:36:23.760937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.760918 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:36:23.764634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:23.764614 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8c3d0966-openshift-default-59d567d575-8s4sx"] Jul 10 19:36:24.909610 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:24.909573 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" path="/var/lib/kubelet/pods/35bf3c5b-7c44-4854-8f4b-6ced386ef07e/volumes" Jul 10 19:36:35.752926 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.752895 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753162 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753173 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753186 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753192 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753259 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.753295 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.753267 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="35bf3c5b-7c44-4854-8f4b-6ced386ef07e" containerName="istio-proxy" Jul 10 19:36:35.755806 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.755788 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.758325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.758304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fbace407-openshift-default-dockercfg-zclf9\"" Jul 10 19:36:35.767488 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.767468 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:36:35.851737 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.851907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.851907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.851907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.851907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.852077 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.852077 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.852077 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.852077 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.851998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffgf\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952786 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.952938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952924 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953259 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953259 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.952976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953259 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.953003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffgf\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953259 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.953241 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953469 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.953264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.953542 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.953520 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.954184 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.954163 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.954397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.954377 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.955220 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.955196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.955393 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.955362 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.960560 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.960531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:35.961506 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:35.961475 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffgf\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf\") pod \"e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:36.065979 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.065895 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:36.193667 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.193620 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:36:36.197483 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:36:36.197441 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2381e4_11af_4cd7_830e_4a55f3cf5680.slice/crio-8158801be95c52d61ba6b11ffc796f1539b8b432b6b1232cb3fad62e5ab62695 WatchSource:0}: Error finding container 8158801be95c52d61ba6b11ffc796f1539b8b432b6b1232cb3fad62e5ab62695: Status 404 returned error can't find the container with id 8158801be95c52d61ba6b11ffc796f1539b8b432b6b1232cb3fad62e5ab62695 Jul 10 19:36:36.200730 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.200674 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:36.200824 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.200775 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:36.200824 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.200815 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:36.795431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.795393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerStarted","Data":"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9"} Jul 10 19:36:36.795832 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.795454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerStarted","Data":"8158801be95c52d61ba6b11ffc796f1539b8b432b6b1232cb3fad62e5ab62695"} Jul 10 19:36:36.815340 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:36.815295 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podStartSLOduration=1.815278841 podStartE2EDuration="1.815278841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:36:36.814097006 +0000 UTC m=+1734.515448111" watchObservedRunningTime="2026-07-10 19:36:36.815278841 +0000 UTC m=+1734.516629944" Jul 10 19:36:37.066756 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:37.066661 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:37.071443 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:37.071419 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:37.799281 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:37.799253 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:37.800132 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:37.800112 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:41.586106 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:41.586074 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:36:51.859593 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.859561 2559 generic.go:356] "Generic (PLEG): container finished" podID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerID="c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9" exitCode=0 Jul 10 19:36:51.860036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.859613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerDied","Data":"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9"} Jul 10 19:36:51.860036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.859966 2559 scope.go:117] "RemoveContainer" containerID="c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9" Jul 10 19:36:51.861020 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.860986 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:51.861120 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.861074 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:51.861181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:51.861122 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:36:52.799675 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:52.799643 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:52.869104 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:52.869063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerStarted","Data":"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8"} Jul 10 19:36:53.067083 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:53.066986 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:53.068121 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:53.068084 2559 patch_prober.go:28] interesting pod/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 10 19:36:53.068253 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:53.068163 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 10 19:36:53.579764 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:53.579724 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:36:54.067174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:54.067135 2559 patch_prober.go:28] interesting pod/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 10 19:36:54.067780 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:54.067746 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 10 19:36:55.066855 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:55.066817 2559 patch_prober.go:28] interesting pod/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 10 19:36:55.067233 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:55.067202 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 10 19:36:56.066595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:56.066558 2559 patch_prober.go:28] interesting pod/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 10 19:36:56.066811 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:56.066625 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 10 19:36:57.066875 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:57.066839 2559 patch_prober.go:28] interesting pod/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jul 10 19:36:57.067446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:57.067415 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jul 10 19:36:58.112187 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:58.112158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:58.112648 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:58.112502 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:36:58.113185 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:36:58.113168 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:37:07.479738 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:37:07.479702 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:37:13.872277 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:37:13.872233 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:37:20.585964 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:37:20.585928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:37:42.848410 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:37:42.848375 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:37:42.849845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:37:42.849823 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:38:01.276043 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:01.276007 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:38:20.190819 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:20.190790 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:38:20.191335 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:20.191010 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" containerID="cri-o://d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8" gracePeriod=30 Jul 10 19:38:23.226646 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:23.226614 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:38:25.426639 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.426613 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:38:25.472765 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472685 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.472896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472812 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.472896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472837 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.472896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472865 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ffgf\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.472896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472883 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.473115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472904 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.473115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472958 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.473115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.472986 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.473115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data\") pod \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\" (UID: \"bb2381e4-11af-4cd7-830e-4a55f3cf5680\") " Jul 10 19:38:25.473319 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473120 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:38:25.473319 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473307 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:38:25.473431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473347 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.473431 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473353 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:38:25.473540 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473482 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:38:25.473618 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.473594 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:38:25.475122 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.475091 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf" (OuterVolumeSpecName: "kube-api-access-8ffgf") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "kube-api-access-8ffgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:38:25.475279 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.475256 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:38:25.475454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.475429 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:38:25.475454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.475440 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb2381e4-11af-4cd7-830e-4a55f3cf5680" (UID: "bb2381e4-11af-4cd7-830e-4a55f3cf5680"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:38:25.573997 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.573968 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.573997 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.573992 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.573997 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574001 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.574181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574010 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.574181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574018 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.574181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574026 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ffgf\" (UniqueName: \"kubernetes.io/projected/bb2381e4-11af-4cd7-830e-4a55f3cf5680-kube-api-access-8ffgf\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.574181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574035 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:25.574181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:25.574043 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb2381e4-11af-4cd7-830e-4a55f3cf5680-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:38:26.260469 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.260437 2559 generic.go:356] "Generic (PLEG): container finished" podID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerID="d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8" exitCode=0 Jul 10 19:38:26.260634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.260480 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" Jul 10 19:38:26.260634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.260517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerDied","Data":"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8"} Jul 10 19:38:26.260634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.260567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc" event={"ID":"bb2381e4-11af-4cd7-830e-4a55f3cf5680","Type":"ContainerDied","Data":"8158801be95c52d61ba6b11ffc796f1539b8b432b6b1232cb3fad62e5ab62695"} Jul 10 19:38:26.260634 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.260589 2559 scope.go:117] "RemoveContainer" containerID="d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8" Jul 10 19:38:26.268964 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.268945 2559 scope.go:117] "RemoveContainer" containerID="c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9" Jul 10 19:38:26.276266 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.276250 2559 scope.go:117] "RemoveContainer" containerID="d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8" Jul 10 19:38:26.276486 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:38:26.276469 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8\": container with ID starting with d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8 not found: ID does not exist" containerID="d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8" Jul 10 19:38:26.276525 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.276494 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8"} err="failed to get container status \"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8\": rpc error: code = NotFound desc = could not find container \"d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8\": container with ID starting with d07b9f945afe64a7ab238f938dffbebfcc43868d112329b35e784b360ccb84f8 not found: ID does not exist" Jul 10 19:38:26.276525 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.276511 2559 scope.go:117] "RemoveContainer" containerID="c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9" Jul 10 19:38:26.276782 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:38:26.276765 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9\": container with ID starting with c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9 not found: ID does not exist" containerID="c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9" Jul 10 19:38:26.276828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.276788 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9"} err="failed to get container status \"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9\": rpc error: code = NotFound desc = could not find container \"c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9\": container with ID starting with c3f0ae29aa24f1ad70fd36d86a1282fa2d89af535c36832b635992b890fba8a9 not found: ID does not exist" Jul 10 19:38:26.284298 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.284276 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:38:26.289042 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.289022 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fbace407-openshift-default-78dbc8dff-kkjjc"] Jul 10 19:38:26.910662 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:26.910629 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" path="/var/lib/kubelet/pods/bb2381e4-11af-4cd7-830e-4a55f3cf5680/volumes" Jul 10 19:38:33.095392 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:38:33.095353 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:39:16.964958 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.964921 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:39:16.965350 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.965317 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:16.965350 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.965332 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:16.965434 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.965421 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:16.968207 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.968190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.970832 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.970803 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-dac879-openshift-default-dockercfg-t9rzd\"" Jul 10 19:39:16.976789 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.976760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqggc\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.976874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.976815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.976874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.976858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.976960 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.976925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.977004 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.976974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.977045 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.977003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.977045 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.977026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.977120 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.977052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.977120 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.977090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:16.983107 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:16.983083 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:39:17.078123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078123 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqggc\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078362 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078669 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078669 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078523 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078822 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078666 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078822 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078714 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.078822 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.078791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.079042 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.079020 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.080543 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.080523 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.080839 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.080821 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.085801 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.085780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqggc\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.085927 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.085906 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token\") pod \"e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.279005 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.278922 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:17.408041 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.407971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:39:17.410169 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:39:17.410144 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ea8006_e333_458c_9cc2_c20d506c9763.slice/crio-9946ac2054c35ae5a9e7bcb6be342a5e60725d2d7b2682572b7235a65d584528 WatchSource:0}: Error finding container 9946ac2054c35ae5a9e7bcb6be342a5e60725d2d7b2682572b7235a65d584528: Status 404 returned error can't find the container with id 9946ac2054c35ae5a9e7bcb6be342a5e60725d2d7b2682572b7235a65d584528 Jul 10 19:39:17.412213 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.412179 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:17.412315 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.412260 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:17.412315 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.412306 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:17.472004 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.471973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerStarted","Data":"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78"} Jul 10 19:39:17.472102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:17.472035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerStarted","Data":"9946ac2054c35ae5a9e7bcb6be342a5e60725d2d7b2682572b7235a65d584528"} Jul 10 19:39:18.499355 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:18.499292 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podStartSLOduration=2.499266976 podStartE2EDuration="2.499266976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:39:18.496730576 +0000 UTC m=+1896.198081680" watchObservedRunningTime="2026-07-10 19:39:18.499266976 +0000 UTC m=+1896.200618081" Jul 10 19:39:19.280162 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:19.280124 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:19.284949 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:19.284927 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:19.480796 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:19.480761 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:19.481794 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:19.481771 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:23.467417 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:23.467375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:39:25.523084 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.523048 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:39:25.523533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.523477 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:25.523533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.523495 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:25.523645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.523584 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2381e4-11af-4cd7-830e-4a55f3cf5680" containerName="istio-proxy" Jul 10 19:39:25.526595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.526573 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.529948 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.529928 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-43c766-openshift-default-dockercfg-sgvhm\"" Jul 10 19:39:25.541571 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.541547 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:39:25.550641 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkx9c\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550781 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550781 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550860 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550860 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550922 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550955 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.550955 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.551023 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.550971 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651747 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkx9c\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.651935 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652312 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.651949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652370 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.652325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652471 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.652434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652588 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.652503 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652725 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.652679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.652774 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.652755 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.654369 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.654346 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.654475 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.654462 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.664019 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.663561 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkx9c\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.664019 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.663970 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token\") pod \"e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:25.837994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:25.837898 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:26.017425 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.017394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:39:26.021764 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:39:26.021736 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d74884_2757_455a_8c1b_a9b0c683b751.slice/crio-3a3238c3ebded9fcb07b53cfa0658390786e1ac5cdeb5d5fa37a3955210546de WatchSource:0}: Error finding container 3a3238c3ebded9fcb07b53cfa0658390786e1ac5cdeb5d5fa37a3955210546de: Status 404 returned error can't find the container with id 3a3238c3ebded9fcb07b53cfa0658390786e1ac5cdeb5d5fa37a3955210546de Jul 10 19:39:26.023969 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.023931 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:26.024041 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.024016 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:26.024075 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.024056 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:26.514348 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.514311 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerStarted","Data":"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0"} Jul 10 19:39:26.514543 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.514361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerStarted","Data":"3a3238c3ebded9fcb07b53cfa0658390786e1ac5cdeb5d5fa37a3955210546de"} Jul 10 19:39:26.535747 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.535702 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podStartSLOduration=1.535666701 podStartE2EDuration="1.535666701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:39:26.533684927 +0000 UTC m=+1904.235036031" watchObservedRunningTime="2026-07-10 19:39:26.535666701 +0000 UTC m=+1904.237017806" Jul 10 19:39:26.838055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:26.837968 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:27.843506 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:27.843476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:28.522512 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:28.522486 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:28.523456 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:28.523437 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:31.768568 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:31.768534 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:39:33.544442 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.544412 2559 generic.go:356] "Generic (PLEG): container finished" podID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerID="1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78" exitCode=0 Jul 10 19:39:33.544861 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.544486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerDied","Data":"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78"} Jul 10 19:39:33.544921 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.544906 2559 scope.go:117] "RemoveContainer" containerID="1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78" Jul 10 19:39:33.545917 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.545890 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:33.546030 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.545955 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:33.546030 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:33.545987 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:34.481625 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:34.481582 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:34.550814 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:34.550780 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerStarted","Data":"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1"} Jul 10 19:39:35.290719 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:35.282144 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:35.290719 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:35.282390 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 19:39:35.290719 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:35.282470 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 19:39:36.279945 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:36.279896 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 19:39:36.280614 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:36.280582 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 19:39:37.279536 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:37.279493 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 19:39:37.279967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:37.279934 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 19:39:38.280791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:38.280314 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 19:39:38.280791 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:38.280378 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 19:39:39.280233 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:39.280190 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 10 19:39:39.280438 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:39.280263 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 10 19:39:40.283713 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:40.283659 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:40.284115 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:40.283964 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:40.284741 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:40.284720 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:39:41.586640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.586555 2559 generic.go:356] "Generic (PLEG): container finished" podID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerID="c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0" exitCode=0 Jul 10 19:39:41.586640 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.586632 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerDied","Data":"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0"} Jul 10 19:39:41.590708 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.588353 2559 scope.go:117] "RemoveContainer" containerID="c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0" Jul 10 19:39:41.591871 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.591820 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:41.591990 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.591967 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:41.592089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:41.592069 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:39:42.375416 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:42.375360 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:39:42.592974 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:42.592939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerStarted","Data":"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8"} Jul 10 19:39:42.838270 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:42.838236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:42.839456 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:42.839429 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 10 19:39:42.839579 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:42.839491 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 10 19:39:43.522952 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:43.522917 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:43.838446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:43.838355 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 10 19:39:43.838446 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:43.838420 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 10 19:39:44.839189 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:44.839144 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 10 19:39:44.839673 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:44.839210 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 10 19:39:45.838686 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:45.838644 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 10 19:39:45.838870 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:45.838743 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 10 19:39:46.839286 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:46.839248 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 10 19:39:46.839724 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:46.839304 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 10 19:39:47.900743 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:47.900710 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:47.902128 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:47.902104 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:39:49.674059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:39:49.674028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:40:24.572182 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:40:24.572142 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:40:33.965948 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:40:33.965867 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:40:46.174654 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:40:46.174621 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:41:25.130244 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:25.130211 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:41:25.130664 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:25.130412 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" containerID="cri-o://3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1" gracePeriod=30 Jul 10 19:41:25.286108 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:25.286073 2559 patch_prober.go:28] interesting pod/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 19:41:25.286260 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:25.286130 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 19:41:28.867575 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:28.867537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:41:30.368804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.368783 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:41:30.535205 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535174 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqggc\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535205 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535209 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535225 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535281 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535318 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535336 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535479 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535367 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535775 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535498 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:30.535775 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535667 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:30.535775 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535739 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:30.535775 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535752 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:41:30.535967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535813 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.535967 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.535838 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy\") pod \"b4ea8006-e333-458c-9cc2-c20d506c9763\" (UID: \"b4ea8006-e333-458c-9cc2-c20d506c9763\") " Jul 10 19:41:30.536074 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536038 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:30.536127 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536096 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.536127 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536111 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.536237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536126 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.536237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536138 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ea8006-e333-458c-9cc2-c20d506c9763-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.536237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.536147 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.537585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.537557 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc" (OuterVolumeSpecName: "kube-api-access-qqggc") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "kube-api-access-qqggc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:41:30.537682 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.537594 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:41:30.537682 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.537593 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:41:30.537782 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.537738 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4ea8006-e333-458c-9cc2-c20d506c9763" (UID: "b4ea8006-e333-458c-9cc2-c20d506c9763"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:30.637302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.637269 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.637302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.637296 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.637302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.637305 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ea8006-e333-458c-9cc2-c20d506c9763-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:30.637302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:30.637314 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqggc\" (UniqueName: \"kubernetes.io/projected/b4ea8006-e333-458c-9cc2-c20d506c9763-kube-api-access-qqggc\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:31.050504 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.050473 2559 generic.go:356] "Generic (PLEG): container finished" podID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerID="3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1" exitCode=0 Jul 10 19:41:31.050713 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.050523 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" Jul 10 19:41:31.050713 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.050547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerDied","Data":"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1"} Jul 10 19:41:31.050713 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.050598 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv" event={"ID":"b4ea8006-e333-458c-9cc2-c20d506c9763","Type":"ContainerDied","Data":"9946ac2054c35ae5a9e7bcb6be342a5e60725d2d7b2682572b7235a65d584528"} Jul 10 19:41:31.050713 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.050620 2559 scope.go:117] "RemoveContainer" containerID="3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1" Jul 10 19:41:31.058806 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.058785 2559 scope.go:117] "RemoveContainer" containerID="1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78" Jul 10 19:41:31.067342 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.067317 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:41:31.067449 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.067341 2559 scope.go:117] "RemoveContainer" containerID="3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1" Jul 10 19:41:31.067637 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:41:31.067615 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1\": container with ID starting with 3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1 not found: ID does not exist" containerID="3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1" Jul 10 19:41:31.067729 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.067647 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1"} err="failed to get container status \"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1\": rpc error: code = NotFound desc = could not find container \"3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1\": container with ID starting with 3da6d74fb2d4d88ff1773198765b0e303b8f6ba01bdb9d1f097c092dd56295d1 not found: ID does not exist" Jul 10 19:41:31.067729 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.067665 2559 scope.go:117] "RemoveContainer" containerID="1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78" Jul 10 19:41:31.067938 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:41:31.067921 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78\": container with ID starting with 1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78 not found: ID does not exist" containerID="1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78" Jul 10 19:41:31.067976 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.067943 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78"} err="failed to get container status \"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78\": rpc error: code = NotFound desc = could not find container \"1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78\": container with ID starting with 1df486d5659cfd009fb8f696fafa03843ed3f2b082622d273c0b3a9d35337a78 not found: ID does not exist" Jul 10 19:41:31.070841 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.070821 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-dac879-openshift-default-65c5f84c8f-nplvv"] Jul 10 19:41:31.815924 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.815879 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:41:31.816754 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:31.816722 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" containerID="cri-o://249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8" gracePeriod=30 Jul 10 19:41:32.661408 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.661372 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:41:32.661706 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.661677 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:32.661706 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.661704 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:32.661799 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.661790 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:32.661832 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.661801 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:32.664402 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.664383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.666988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.666954 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2fa627-openshift-default-dockercfg-975wl\"" Jul 10 19:41:32.674798 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.674776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:41:32.757532 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757783 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757990 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h5fh\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.757990 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.757853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859043 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h5fh\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859043 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859869 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859869 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859614 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859869 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.859869 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.859822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.860187 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.860168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.861498 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.861474 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.861810 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.861789 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.866993 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.866972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.867071 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.866972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h5fh\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh\") pod \"e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:32.903229 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.903201 2559 patch_prober.go:28] interesting pod/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 19:41:32.903339 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.903258 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 19:41:32.909970 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.909946 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" path="/var/lib/kubelet/pods/b4ea8006-e333-458c-9cc2-c20d506c9763/volumes" Jul 10 19:41:32.976324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:32.976297 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:33.111408 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:33.111372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:41:33.114155 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:41:33.114120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7ef6a8_bfdd_4836_8c0b_bfc7faa6402e.slice/crio-99f82b7c6b6f005e8da3b36ca72bd9427ec7d2ba7a181f366e173d0d07d84fe5 WatchSource:0}: Error finding container 99f82b7c6b6f005e8da3b36ca72bd9427ec7d2ba7a181f366e173d0d07d84fe5: Status 404 returned error can't find the container with id 99f82b7c6b6f005e8da3b36ca72bd9427ec7d2ba7a181f366e173d0d07d84fe5 Jul 10 19:41:33.116300 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:33.116262 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:33.116396 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:33.116343 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:33.116396 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:33.116385 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:34.065817 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:34.065784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerStarted","Data":"fb4be170ad0b39b91fc6a0f2a28fc68ded68028b79b8001a116f3bf6eb90ce9d"} Jul 10 19:41:34.066191 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:34.065838 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerStarted","Data":"99f82b7c6b6f005e8da3b36ca72bd9427ec7d2ba7a181f366e173d0d07d84fe5"} Jul 10 19:41:34.086218 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:34.086173 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podStartSLOduration=2.086159539 podStartE2EDuration="2.086159539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:41:34.085484065 +0000 UTC m=+2031.786835169" watchObservedRunningTime="2026-07-10 19:41:34.086159539 +0000 UTC m=+2031.787510643" Jul 10 19:41:34.977175 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:34.977143 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:34.981982 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:34.981955 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:35.069458 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:35.069425 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:35.070374 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:35.070355 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:37.054785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.054751 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:41:37.081898 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.081840 2559 generic.go:356] "Generic (PLEG): container finished" podID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerID="249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8" exitCode=0 Jul 10 19:41:37.081898 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.081886 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" Jul 10 19:41:37.082036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.081916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerDied","Data":"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8"} Jul 10 19:41:37.082036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.081963 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd" event={"ID":"a2d74884-2757-455a-8c1b-a9b0c683b751","Type":"ContainerDied","Data":"3a3238c3ebded9fcb07b53cfa0658390786e1ac5cdeb5d5fa37a3955210546de"} Jul 10 19:41:37.082036 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.081981 2559 scope.go:117] "RemoveContainer" containerID="249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8" Jul 10 19:41:37.091644 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.091620 2559 scope.go:117] "RemoveContainer" containerID="c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0" Jul 10 19:41:37.099452 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.099429 2559 scope.go:117] "RemoveContainer" containerID="249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8" Jul 10 19:41:37.099732 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:41:37.099713 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8\": container with ID starting with 249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8 not found: ID does not exist" containerID="249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8" Jul 10 19:41:37.099795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.099740 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8"} err="failed to get container status \"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8\": rpc error: code = NotFound desc = could not find container \"249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8\": container with ID starting with 249be3263b43d33902ccd1a2bf41a88b217e04fbb92e7da7319d405b794aead8 not found: ID does not exist" Jul 10 19:41:37.099795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.099755 2559 scope.go:117] "RemoveContainer" containerID="c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0" Jul 10 19:41:37.100063 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:41:37.100044 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0\": container with ID starting with c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0 not found: ID does not exist" containerID="c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0" Jul 10 19:41:37.100125 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.100070 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0"} err="failed to get container status \"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0\": rpc error: code = NotFound desc = could not find container \"c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0\": container with ID starting with c8eb1d1395fb7da2beabe3ed9a70137a40e9f84db539b179895c34e8b967dde0 not found: ID does not exist" Jul 10 19:41:37.199165 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199137 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199178 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199198 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199225 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199245 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199279 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199338 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199377 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkx9c\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199433 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket\") pod \"a2d74884-2757-455a-8c1b-a9b0c683b751\" (UID: \"a2d74884-2757-455a-8c1b-a9b0c683b751\") " Jul 10 19:41:37.199562 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199507 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:37.199814 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199603 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:37.199814 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199671 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:41:37.199814 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199767 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:37.199970 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.199933 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:37.200156 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.200135 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.200275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.200171 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.200275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.200187 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.200275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.200201 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2d74884-2757-455a-8c1b-a9b0c683b751-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.200275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.200214 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.201406 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.201381 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:41:37.201635 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.201613 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:41:37.201889 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.201867 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:41:37.201953 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.201932 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c" (OuterVolumeSpecName: "kube-api-access-pkx9c") pod "a2d74884-2757-455a-8c1b-a9b0c683b751" (UID: "a2d74884-2757-455a-8c1b-a9b0c683b751"). InnerVolumeSpecName "kube-api-access-pkx9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:41:37.301503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.301477 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.301503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.301498 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.301503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.301506 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.301767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.301515 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkx9c\" (UniqueName: \"kubernetes.io/projected/a2d74884-2757-455a-8c1b-a9b0c683b751-kube-api-access-pkx9c\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:41:37.402408 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.402379 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:41:37.406118 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:37.406094 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-43c766-openshift-default-8bf5d9-s97rd"] Jul 10 19:41:38.368261 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:38.368224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:41:38.908978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:38.908947 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" path="/var/lib/kubelet/pods/a2d74884-2757-455a-8c1b-a9b0c683b751/volumes" Jul 10 19:41:41.132683 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.132654 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.132947 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.132959 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.132969 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.132974 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ea8006-e333-458c-9cc2-c20d506c9763" containerName="istio-proxy" Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.133031 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:41:41.133055 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.133040 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:41:41.135740 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.135719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.137946 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.137929 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b3f5d9-openshift-default-dockercfg-mhwl8\"" Jul 10 19:41:41.153598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.153570 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:41:41.233386 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233386 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkl52\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.233857 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.233653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334498 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkl52\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334657 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334657 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334657 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334834 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334834 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334834 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334983 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334983 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.334983 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.334941 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.335198 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.335166 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.335273 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.335195 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.335273 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.335219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.335273 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.335248 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.336849 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.336816 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.337144 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.337122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.341625 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.341601 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.341764 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.341735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkl52\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52\") pod \"e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.446189 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.446158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:41.619863 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.619834 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:41:41.622352 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:41:41.622323 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b51774e_4178_4d56_9fab_5fc33f7a5d33.slice/crio-fd6bb5527c6efcf938dc60b9c91db2813e9ff0808c43b8cd246e599e3920b256 WatchSource:0}: Error finding container fd6bb5527c6efcf938dc60b9c91db2813e9ff0808c43b8cd246e599e3920b256: Status 404 returned error can't find the container with id fd6bb5527c6efcf938dc60b9c91db2813e9ff0808c43b8cd246e599e3920b256 Jul 10 19:41:41.624450 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.624411 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:41.624523 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.624484 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:41.624523 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:41.624517 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:42.107037 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:42.107005 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerStarted","Data":"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a"} Jul 10 19:41:42.107206 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:42.107057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerStarted","Data":"fd6bb5527c6efcf938dc60b9c91db2813e9ff0808c43b8cd246e599e3920b256"} Jul 10 19:41:42.145972 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:42.145834 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podStartSLOduration=1.145814442 podStartE2EDuration="1.145814442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:41:42.145326067 +0000 UTC m=+2039.846677168" watchObservedRunningTime="2026-07-10 19:41:42.145814442 +0000 UTC m=+2039.847165549" Jul 10 19:41:42.446588 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:42.446561 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:42.451293 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:42.451272 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:43.111426 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:43.111390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:43.112234 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:43.112217 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:46.272845 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:46.272809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:41:49.138966 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.138938 2559 generic.go:356] "Generic (PLEG): container finished" podID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerID="fb4be170ad0b39b91fc6a0f2a28fc68ded68028b79b8001a116f3bf6eb90ce9d" exitCode=0 Jul 10 19:41:49.139492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.139016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerDied","Data":"fb4be170ad0b39b91fc6a0f2a28fc68ded68028b79b8001a116f3bf6eb90ce9d"} Jul 10 19:41:49.139492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.139486 2559 scope.go:117] "RemoveContainer" containerID="fb4be170ad0b39b91fc6a0f2a28fc68ded68028b79b8001a116f3bf6eb90ce9d" Jul 10 19:41:49.140462 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.140436 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:49.140559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.140502 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:49.140559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:49.140533 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:50.070239 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:50.070137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:50.145229 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:50.145197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerStarted","Data":"670cb1f22bb0d4823b39f791e796a19a19ed8a1cad032c0a07db371b03b5acfd"} Jul 10 19:41:50.977706 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:50.977649 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:50.978851 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:50.978809 2559 patch_prober.go:28] interesting pod/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 10 19:41:50.979458 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:50.979425 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 10 19:41:51.977097 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:51.977050 2559 patch_prober.go:28] interesting pod/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 10 19:41:51.977600 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:51.977118 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 10 19:41:52.977059 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:52.977008 2559 patch_prober.go:28] interesting pod/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 10 19:41:52.977276 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:52.977081 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 10 19:41:53.977951 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:53.977431 2559 patch_prober.go:28] interesting pod/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 10 19:41:53.977951 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:53.977514 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 10 19:41:54.977230 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:54.977193 2559 patch_prober.go:28] interesting pod/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jul 10 19:41:54.977503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:54.977474 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jul 10 19:41:55.980988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:55.980962 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:55.981377 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:55.981234 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:55.981916 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:55.981896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:41:56.183109 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.183076 2559 generic.go:356] "Generic (PLEG): container finished" podID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerID="0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a" exitCode=0 Jul 10 19:41:56.183272 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.183153 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerDied","Data":"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a"} Jul 10 19:41:56.183590 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.183575 2559 scope.go:117] "RemoveContainer" containerID="0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a" Jul 10 19:41:56.184503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.184476 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:56.184574 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.184557 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:56.184636 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:56.184619 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:41:57.193293 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:57.193250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerStarted","Data":"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740"} Jul 10 19:41:57.446748 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:57.446673 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:57.447756 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:57.447729 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:41:57.447896 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:57.447784 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:41:58.112038 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:58.111993 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:41:58.446795 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:58.446770 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:41:58.447139 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:58.446819 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:41:59.446538 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:59.446499 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:41:59.446769 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:59.446564 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:41:59.965655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:41:59.965613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:42:00.447440 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:00.447412 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:42:00.447585 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:00.447462 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:42:01.447159 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:01.447121 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:42:01.447618 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:01.447183 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:42:02.447101 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:02.447067 2559 patch_prober.go:28] interesting pod/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 10 19:42:02.447274 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:02.447130 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 10 19:42:03.016434 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:03.016398 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:42:03.016633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:03.016607 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" containerID="cri-o://670cb1f22bb0d4823b39f791e796a19a19ed8a1cad032c0a07db371b03b5acfd" gracePeriod=30 Jul 10 19:42:03.450543 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:03.450517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:42:03.451449 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:03.451432 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:42:06.472586 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:06.472545 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:42:08.243710 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.243659 2559 generic.go:356] "Generic (PLEG): container finished" podID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerID="670cb1f22bb0d4823b39f791e796a19a19ed8a1cad032c0a07db371b03b5acfd" exitCode=0 Jul 10 19:42:08.244114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.243722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerDied","Data":"670cb1f22bb0d4823b39f791e796a19a19ed8a1cad032c0a07db371b03b5acfd"} Jul 10 19:42:08.244114 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.243810 2559 scope.go:117] "RemoveContainer" containerID="fb4be170ad0b39b91fc6a0f2a28fc68ded68028b79b8001a116f3bf6eb90ce9d" Jul 10 19:42:08.270841 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.270815 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:42:08.379133 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379056 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379133 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379092 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h5fh\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379133 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379113 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379140 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379160 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379180 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379203 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379241 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379314 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo\") pod \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\" (UID: \"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e\") " Jul 10 19:42:08.379397 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379331 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:08.379780 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379420 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:08.379780 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379578 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:08.379780 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379673 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:08.379780 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379731 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:42:08.379937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379866 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.379937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379885 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.379937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379899 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.379937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379910 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.379937 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.379923 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.381368 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.381343 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:08.381474 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.381453 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:42:08.381736 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.381715 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh" (OuterVolumeSpecName: "kube-api-access-9h5fh") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "kube-api-access-9h5fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:42:08.382034 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.381741 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" (UID: "6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:42:08.481022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.480993 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.481022 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.481019 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h5fh\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-kube-api-access-9h5fh\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.481171 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.481030 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:08.481171 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:08.481038 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:09.249374 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.249343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" event={"ID":"6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e","Type":"ContainerDied","Data":"99f82b7c6b6f005e8da3b36ca72bd9427ec7d2ba7a181f366e173d0d07d84fe5"} Jul 10 19:42:09.249776 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.249395 2559 scope.go:117] "RemoveContainer" containerID="670cb1f22bb0d4823b39f791e796a19a19ed8a1cad032c0a07db371b03b5acfd" Jul 10 19:42:09.249776 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.249356 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz" Jul 10 19:42:09.267316 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.267289 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:42:09.270460 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.270439 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2fa627-openshift-default-7484b647d7-ngsdz"] Jul 10 19:42:09.911258 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.911225 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:42:09.911482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:09.911456 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" containerID="cri-o://1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740" gracePeriod=30 Jul 10 19:42:10.716448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716419 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716737 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716751 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716765 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716770 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716784 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:42:10.716828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716789 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d74884-2757-455a-8c1b-a9b0c683b751" containerName="istio-proxy" Jul 10 19:42:10.717041 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716840 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.717041 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.716848 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" containerName="istio-proxy" Jul 10 19:42:10.719598 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.719580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.722994 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.722976 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f25aa8-openshift-default-dockercfg-bsclv\"" Jul 10 19:42:10.742015 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.741994 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:42:10.801336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801493 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801493 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801493 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801676 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801676 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801676 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fscw\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801676 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.801938 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.801716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.902449 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.902655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.902655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.902655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.902655 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fscw\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.902769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903025 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903177 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903174 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.903559 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.903381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.904956 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.904923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.905380 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.905360 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.910900 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.910873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:10.911222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.911203 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e" path="/var/lib/kubelet/pods/6c7ef6a8-bfdd-4836-8c0b-bfc7faa6402e/volumes" Jul 10 19:42:10.911544 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:10.911524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fscw\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw\") pod \"e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:11.029250 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.029171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:11.161236 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.161212 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:42:11.163746 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:42:11.163715 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a540a7_a683_4606_9e19_7a2d449c643b.slice/crio-3099a6cf8f950ed5bfb26b253ad1e4dd37c12c350f5a78fa5a2107a09ecc20d4 WatchSource:0}: Error finding container 3099a6cf8f950ed5bfb26b253ad1e4dd37c12c350f5a78fa5a2107a09ecc20d4: Status 404 returned error can't find the container with id 3099a6cf8f950ed5bfb26b253ad1e4dd37c12c350f5a78fa5a2107a09ecc20d4 Jul 10 19:42:11.165772 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.165743 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:11.165892 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.165803 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:11.165892 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.165833 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:11.261198 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.261155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerStarted","Data":"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2"} Jul 10 19:42:11.261343 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.261217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerStarted","Data":"3099a6cf8f950ed5bfb26b253ad1e4dd37c12c350f5a78fa5a2107a09ecc20d4"} Jul 10 19:42:11.281142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:11.281049 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podStartSLOduration=1.281029974 podStartE2EDuration="1.281029974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:42:11.27923548 +0000 UTC m=+2068.980586598" watchObservedRunningTime="2026-07-10 19:42:11.281029974 +0000 UTC m=+2068.982381148" Jul 10 19:42:12.029674 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:12.029635 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:12.034336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:12.034313 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:12.265369 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:12.265343 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:12.266348 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:12.266328 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:15.155541 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.155517 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:42:15.241656 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241627 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241681 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241720 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241749 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241764 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241783 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241809 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.241874 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241838 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.242242 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241931 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkl52\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52\") pod \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\" (UID: \"1b51774e-4178-4d56-9fab-5fc33f7a5d33\") " Jul 10 19:42:15.242242 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.241985 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:15.242242 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242052 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:15.242242 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242077 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:15.242448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242243 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.242448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242262 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.242448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242275 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.242448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242316 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:15.242448 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.242334 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:42:15.244184 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.244149 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:42:15.244184 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.244163 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52" (OuterVolumeSpecName: "kube-api-access-gkl52") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "kube-api-access-gkl52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:42:15.244354 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.244337 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:42:15.244485 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.244466 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b51774e-4178-4d56-9fab-5fc33f7a5d33" (UID: "1b51774e-4178-4d56-9fab-5fc33f7a5d33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:42:15.279836 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.279802 2559 generic.go:356] "Generic (PLEG): container finished" podID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerID="1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740" exitCode=0 Jul 10 19:42:15.279995 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.279854 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" Jul 10 19:42:15.279995 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.279878 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerDied","Data":"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740"} Jul 10 19:42:15.279995 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.279935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd" event={"ID":"1b51774e-4178-4d56-9fab-5fc33f7a5d33","Type":"ContainerDied","Data":"fd6bb5527c6efcf938dc60b9c91db2813e9ff0808c43b8cd246e599e3920b256"} Jul 10 19:42:15.279995 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.279962 2559 scope.go:117] "RemoveContainer" containerID="1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740" Jul 10 19:42:15.288284 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.288268 2559 scope.go:117] "RemoveContainer" containerID="0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a" Jul 10 19:42:15.295759 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.295740 2559 scope.go:117] "RemoveContainer" containerID="1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740" Jul 10 19:42:15.295982 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:42:15.295964 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740\": container with ID starting with 1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740 not found: ID does not exist" containerID="1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740" Jul 10 19:42:15.296054 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.295996 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740"} err="failed to get container status \"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740\": rpc error: code = NotFound desc = could not find container \"1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740\": container with ID starting with 1e42fe889fb1fde6f874162f4dcf3d42b9cc97c879851917602a40673b974740 not found: ID does not exist" Jul 10 19:42:15.296054 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.296021 2559 scope.go:117] "RemoveContainer" containerID="0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a" Jul 10 19:42:15.296266 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:42:15.296250 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a\": container with ID starting with 0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a not found: ID does not exist" containerID="0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a" Jul 10 19:42:15.296305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.296273 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a"} err="failed to get container status \"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a\": rpc error: code = NotFound desc = could not find container \"0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a\": container with ID starting with 0a3a78c186a799ebef5a28b34e28cdac925ad00e5f229ded3c08c3b3957a763a not found: ID does not exist" Jul 10 19:42:15.300181 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.300159 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:42:15.308828 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.308808 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b3f5d9-openshift-default-55b7dd6467-g6ccd"] Jul 10 19:42:15.343342 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343316 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkl52\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-kube-api-access-gkl52\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.343342 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343339 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.343466 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343351 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b51774e-4178-4d56-9fab-5fc33f7a5d33-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.343466 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343360 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.343466 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343367 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:15.343466 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:15.343374 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b51774e-4178-4d56-9fab-5fc33f7a5d33-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:42:16.763542 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:16.763508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:42:16.912336 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:16.912304 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" path="/var/lib/kubelet/pods/1b51774e-4178-4d56-9fab-5fc33f7a5d33/volumes" Jul 10 19:42:18.246848 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.246818 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:42:18.247296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.247154 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:42:18.247296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.247169 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:42:18.247296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.247194 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:42:18.247296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.247202 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:42:18.247296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.247285 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:42:18.250296 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.250277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.252775 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.252752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fc4b18-openshift-default-dockercfg-6vzd5\"" Jul 10 19:42:18.273627 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.273593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:42:18.368563 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.368785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.368785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.368785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.368785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368736 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.368785 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgcr\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.369065 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.369065 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.369065 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.368897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.469999 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.469950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgcr\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470228 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470213 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470601 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.470711 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.470671 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.471286 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.471260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.472365 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.472313 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.472705 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.472661 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.472929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.472899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.476486 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.476459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.479026 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.478979 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.479236 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.479211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.483332 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.483285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgcr\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr\") pod \"e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.561275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.560954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:18.729584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.729554 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:42:18.732095 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:42:18.732060 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bec94e6_b67b_4252_9dd3_a7c07a60cb76.slice/crio-a834a04dcd6fb0e7f0556e7e45043e5437ac7bfd5743b27276893cf8123ea013 WatchSource:0}: Error finding container a834a04dcd6fb0e7f0556e7e45043e5437ac7bfd5743b27276893cf8123ea013: Status 404 returned error can't find the container with id a834a04dcd6fb0e7f0556e7e45043e5437ac7bfd5743b27276893cf8123ea013 Jul 10 19:42:18.734351 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.734313 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:18.734419 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.734385 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:18.734454 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:18.734417 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:19.300847 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:19.300810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerStarted","Data":"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58"} Jul 10 19:42:19.301385 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:19.300866 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerStarted","Data":"a834a04dcd6fb0e7f0556e7e45043e5437ac7bfd5743b27276893cf8123ea013"} Jul 10 19:42:19.320645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:19.320590 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podStartSLOduration=1.320573189 podStartE2EDuration="1.320573189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:42:19.319759657 +0000 UTC m=+2077.021110770" watchObservedRunningTime="2026-07-10 19:42:19.320573189 +0000 UTC m=+2077.021924294" Jul 10 19:42:19.561685 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:19.561588 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:19.573335 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:19.573306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:20.305716 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:20.305667 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:20.306858 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:20.306839 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:24.963881 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:24.963845 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:42:27.267239 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.267199 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:27.268148 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.267855 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:27.337482 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.337451 2559 generic.go:356] "Generic (PLEG): container finished" podID="13a540a7-a683-4606-9e19-7a2d449c643b" containerID="65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2" exitCode=0 Jul 10 19:42:27.337666 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.337527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerDied","Data":"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2"} Jul 10 19:42:27.337988 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.337970 2559 scope.go:117] "RemoveContainer" containerID="65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2" Jul 10 19:42:27.339490 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.339418 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:27.339630 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.339610 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:27.339759 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:27.339736 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:28.344048 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:28.344014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerStarted","Data":"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004"} Jul 10 19:42:29.030536 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:29.030500 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:29.030745 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:29.030601 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:29.030745 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:29.030646 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:30.029584 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:30.029543 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:30.030026 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:30.029605 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:31.029619 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:31.029587 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:31.030080 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:31.029807 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:32.029945 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:32.029905 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:32.030302 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:32.029965 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:33.030432 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:33.030382 2559 patch_prober.go:28] interesting pod/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 10 19:42:33.030949 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:33.030443 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 10 19:42:34.033270 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:34.033241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:34.033641 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:34.033517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:34.034325 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:34.034306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:42:35.307098 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.307064 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:35.307503 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.307116 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:35.384705 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.384666 2559 generic.go:356] "Generic (PLEG): container finished" podID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerID="59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58" exitCode=0 Jul 10 19:42:35.384849 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.384741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerDied","Data":"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58"} Jul 10 19:42:35.385269 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.385252 2559 scope.go:117] "RemoveContainer" containerID="59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58" Jul 10 19:42:35.386288 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.386257 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:35.386406 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.386349 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:35.386406 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:35.386395 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 19:42:36.390858 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:36.390824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerStarted","Data":"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c"} Jul 10 19:42:36.562603 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:36.562569 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:36.562907 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:36.562879 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:36.563070 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:36.563043 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:37.572128 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:37.572090 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:37.572633 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:37.572157 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:38.562152 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:38.562117 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:38.562575 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:38.562542 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:39.562118 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:39.562080 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:39.562684 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:39.562652 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:40.294888 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:40.294852 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:42:40.562126 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:40.562036 2559 patch_prober.go:28] interesting pod/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 10 19:42:40.562387 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:40.562357 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 10 19:42:41.579553 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:41.579514 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:41.580049 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:41.579886 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:41.581803 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:41.581777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:42:42.871607 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:42.871573 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:42:42.873619 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:42:42.873600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:43:00.268357 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:43:00.268322 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:43:21.572544 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:43:21.572507 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:43:32.583731 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:43:32.583681 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:43:44.573436 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:43:44.573357 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:43:56.168102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:43:56.168064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:44:07.976981 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:44:07.976939 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:44:19.479646 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:44:19.479611 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:44:30.984561 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:44:30.984521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:44:40.778416 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:44:40.778380 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:45:06.198928 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:45:06.198897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:45:28.247607 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:45:28.247574 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:45:40.513646 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:45:40.513603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:45:52.833569 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:45:52.833532 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:46:00.138927 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.138891 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:46:00.139377 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.139247 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b51774e-4178-4d56-9fab-5fc33f7a5d33" containerName="istio-proxy" Jul 10 19:46:00.141040 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.141023 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.146405 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.146380 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f25aa8\"/\"default-dockercfg-7jgqb\"" Jul 10 19:46:00.146543 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.146383 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f25aa8\"/\"openshift-service-ca.crt\"" Jul 10 19:46:00.146543 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.146387 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f25aa8\"/\"kube-root-ca.crt\"" Jul 10 19:46:00.147159 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.147138 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f25aa8\"/\"rate-test-model-f25aa8-kserve-self-signed-certs\"" Jul 10 19:46:00.157174 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.157153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:46:00.237473 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69dc\" (UniqueName: \"kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.237650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.237650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.237650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.237650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.237650 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.237607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338800 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p69dc\" (UniqueName: \"kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.338978 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.338969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.339271 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.339246 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.339445 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.339322 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.339515 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.339376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.341116 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.341093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.341394 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.341375 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.348219 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.348197 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69dc\" (UniqueName: \"kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc\") pod \"rate-test-model-f25aa8-kserve-899f96b4c-4whgx\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.449835 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.449801 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:00.582284 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:00.582254 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:46:00.585229 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:46:00.585195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb52f33a8_55e0_4d86_a578_6c337d0367a5.slice/crio-e1d9e4f64e3285fcbbb70c064f084da952ac9b228028bbe0158986e5e4bdc2ae WatchSource:0}: Error finding container e1d9e4f64e3285fcbbb70c064f084da952ac9b228028bbe0158986e5e4bdc2ae: Status 404 returned error can't find the container with id e1d9e4f64e3285fcbbb70c064f084da952ac9b228028bbe0158986e5e4bdc2ae Jul 10 19:46:01.235193 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:01.235155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" event={"ID":"b52f33a8-55e0-4d86-a578-6c337d0367a5","Type":"ContainerStarted","Data":"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7"} Jul 10 19:46:01.235193 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:01.235197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" event={"ID":"b52f33a8-55e0-4d86-a578-6c337d0367a5","Type":"ContainerStarted","Data":"e1d9e4f64e3285fcbbb70c064f084da952ac9b228028bbe0158986e5e4bdc2ae"} Jul 10 19:46:01.259924 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:01.259878 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" podStartSLOduration=1.259863766 podStartE2EDuration="1.259863766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:46:01.256838298 +0000 UTC m=+2298.958189403" watchObservedRunningTime="2026-07-10 19:46:01.259863766 +0000 UTC m=+2298.961214911" Jul 10 19:46:03.236291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:03.236258 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:46:10.450062 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:10.450025 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:10.450062 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:10.450072 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:10.462566 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:10.462544 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:11.288141 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:11.288106 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:46:35.695195 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:35.695119 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:46:53.098092 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:46:53.098051 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:47:03.186268 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:03.186233 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:47:09.583960 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:09.583926 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:47:12.898185 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:12.898147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:47:24.603806 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.603771 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" podUID="b52f33a8-55e0-4d86-a578-6c337d0367a5" containerName="main" containerID="cri-o://7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7" gracePeriod=45 Jul 10 19:47:24.847329 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.847307 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:47:24.925872 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925799 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p69dc\" (UniqueName: \"kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.925872 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925857 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.926089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925904 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.926089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925921 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.926089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925934 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.926089 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.925953 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs\") pod \"b52f33a8-55e0-4d86-a578-6c337d0367a5\" (UID: \"b52f33a8-55e0-4d86-a578-6c337d0367a5\") " Jul 10 19:47:24.926314 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.926149 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:24.926314 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.926183 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:24.926314 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.926228 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:24.926314 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.926247 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home" (OuterVolumeSpecName: "home") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:24.928040 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.928013 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc" (OuterVolumeSpecName: "kube-api-access-p69dc") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "kube-api-access-p69dc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:47:24.928157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.928039 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm" (OuterVolumeSpecName: "dshm") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:24.928157 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:24.928045 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b52f33a8-55e0-4d86-a578-6c337d0367a5" (UID: "b52f33a8-55e0-4d86-a578-6c337d0367a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 19:47:25.027300 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.027267 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p69dc\" (UniqueName: \"kubernetes.io/projected/b52f33a8-55e0-4d86-a578-6c337d0367a5-kube-api-access-p69dc\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:25.027300 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.027295 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:25.027300 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.027305 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:25.027528 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.027312 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52f33a8-55e0-4d86-a578-6c337d0367a5-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:25.027528 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.027320 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52f33a8-55e0-4d86-a578-6c337d0367a5-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:25.605320 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.605281 2559 generic.go:356] "Generic (PLEG): container finished" podID="b52f33a8-55e0-4d86-a578-6c337d0367a5" containerID="7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7" exitCode=0 Jul 10 19:47:25.605820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.605346 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" Jul 10 19:47:25.605820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.605369 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" event={"ID":"b52f33a8-55e0-4d86-a578-6c337d0367a5","Type":"ContainerDied","Data":"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7"} Jul 10 19:47:25.605820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.605418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx" event={"ID":"b52f33a8-55e0-4d86-a578-6c337d0367a5","Type":"ContainerDied","Data":"e1d9e4f64e3285fcbbb70c064f084da952ac9b228028bbe0158986e5e4bdc2ae"} Jul 10 19:47:25.605820 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.605442 2559 scope.go:117] "RemoveContainer" containerID="7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7" Jul 10 19:47:25.614305 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.614286 2559 scope.go:117] "RemoveContainer" containerID="7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7" Jul 10 19:47:25.614597 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:47:25.614581 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7\": container with ID starting with 7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7 not found: ID does not exist" containerID="7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7" Jul 10 19:47:25.614645 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.614604 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7"} err="failed to get container status \"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7\": rpc error: code = NotFound desc = could not find container \"7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7\": container with ID starting with 7174be7163487bc85bfecd3c53b824c9df1395d06f59bf7e54cdfee1859c09c7 not found: ID does not exist" Jul 10 19:47:25.626294 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.626274 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:47:25.631789 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:25.631769 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f25aa8/rate-test-model-f25aa8-kserve-899f96b4c-4whgx"] Jul 10 19:47:26.909626 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:26.909588 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b52f33a8-55e0-4d86-a578-6c337d0367a5" path="/var/lib/kubelet/pods/b52f33a8-55e0-4d86-a578-6c337d0367a5/volumes" Jul 10 19:47:33.579913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:33.579879 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:47:37.239669 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:37.239639 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:47:37.241088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:37.239868 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" containerID="cri-o://584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004" gracePeriod=30 Jul 10 19:47:41.974531 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:41.974495 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-r7ttl"] Jul 10 19:47:42.482231 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.482209 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:47:42.580291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580206 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580252 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580291 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580278 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580310 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fscw\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580343 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580411 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580435 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580484 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580520 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data\") pod \"13a540a7-a683-4606-9e19-7a2d449c643b\" (UID: \"13a540a7-a683-4606-9e19-7a2d449c643b\") " Jul 10 19:47:42.580913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580581 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:42.580913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580796 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:47:42.580913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580787 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:42.580913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580804 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.580913 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580852 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data" (OuterVolumeSpecName: "istio-data") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:42.581160 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.580959 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:42.582405 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.582379 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:42.582571 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.582552 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:47:42.582918 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.582888 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw" (OuterVolumeSpecName: "kube-api-access-8fscw") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "kube-api-access-8fscw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:47:42.583011 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.582942 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token" (OuterVolumeSpecName: "istio-token") pod "13a540a7-a683-4606-9e19-7a2d449c643b" (UID: "13a540a7-a683-4606-9e19-7a2d449c643b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:47:42.677980 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.677944 2559 generic.go:356] "Generic (PLEG): container finished" podID="13a540a7-a683-4606-9e19-7a2d449c643b" containerID="584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004" exitCode=0 Jul 10 19:47:42.678142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.678000 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" Jul 10 19:47:42.678142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.678016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerDied","Data":"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004"} Jul 10 19:47:42.678142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.678069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z" event={"ID":"13a540a7-a683-4606-9e19-7a2d449c643b","Type":"ContainerDied","Data":"3099a6cf8f950ed5bfb26b253ad1e4dd37c12c350f5a78fa5a2107a09ecc20d4"} Jul 10 19:47:42.678142 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.678099 2559 scope.go:117] "RemoveContainer" containerID="584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004" Jul 10 19:47:42.681277 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681253 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681277 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681273 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681277 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681282 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13a540a7-a683-4606-9e19-7a2d449c643b-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681290 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fscw\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-kube-api-access-8fscw\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681299 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13a540a7-a683-4606-9e19-7a2d449c643b-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681308 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681316 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a540a7-a683-4606-9e19-7a2d449c643b-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.681509 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.681324 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a540a7-a683-4606-9e19-7a2d449c643b-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:42.687133 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.687112 2559 scope.go:117] "RemoveContainer" containerID="65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2" Jul 10 19:47:42.694486 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.694463 2559 scope.go:117] "RemoveContainer" containerID="584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004" Jul 10 19:47:42.694743 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:47:42.694723 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004\": container with ID starting with 584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004 not found: ID does not exist" containerID="584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004" Jul 10 19:47:42.694804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.694750 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004"} err="failed to get container status \"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004\": rpc error: code = NotFound desc = could not find container \"584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004\": container with ID starting with 584383635cfa5c0de68307ae87039d50095811b2ebcc36f629ff5fa75f9d8004 not found: ID does not exist" Jul 10 19:47:42.694804 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.694766 2559 scope.go:117] "RemoveContainer" containerID="65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2" Jul 10 19:47:42.694994 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:47:42.694978 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2\": container with ID starting with 65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2 not found: ID does not exist" containerID="65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2" Jul 10 19:47:42.695033 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.694997 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2"} err="failed to get container status \"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2\": rpc error: code = NotFound desc = could not find container \"65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2\": container with ID starting with 65b2c8cf5e42c22000642822234ea8fdf76729ec1b2c1192ec42a32abe78c4c2 not found: ID does not exist" Jul 10 19:47:42.701852 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.701829 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:47:42.705460 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.705436 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f25aa8-openshift-default-57cd7d4c4c-clb4z"] Jul 10 19:47:42.897581 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.897493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:47:42.902328 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.902303 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-spzpw_d56a244c-3a5b-4db5-b5cd-1022527323cd/ovn-acl-logging/0.log" Jul 10 19:47:42.910768 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:42.910740 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" path="/var/lib/kubelet/pods/13a540a7-a683-4606-9e19-7a2d449c643b/volumes" Jul 10 19:47:44.614505 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:44.614476 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:47:44.614915 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:44.614668 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" containerID="cri-o://592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c" gracePeriod=30 Jul 10 19:47:49.851101 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.851079 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:47:49.939917 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.939846 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.939917 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.939875 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.939917 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.939908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.939933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.939984 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940001 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpgcr\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940024 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940048 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940188 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940075 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy\") pod \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\" (UID: \"9bec94e6-b67b-4252-9dd3-a7c07a60cb76\") " Jul 10 19:47:49.940485 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940356 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:49.940485 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940379 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:49.940485 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940394 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:49.940767 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940738 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:49.940924 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.940904 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 19:47:49.942151 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.942123 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:47:49.942254 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.942152 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 19:47:49.942254 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.942189 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr" (OuterVolumeSpecName: "kube-api-access-wpgcr") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "kube-api-access-wpgcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 19:47:49.942349 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:49.942267 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bec94e6-b67b-4252-9dd3-a7c07a60cb76" (UID: "9bec94e6-b67b-4252-9dd3-a7c07a60cb76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 19:47:50.040846 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040814 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-credential-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.040846 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040841 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-envoy\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040853 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-podinfo\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040867 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istiod-ca-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040878 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040888 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040898 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-istio-data\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040911 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpgcr\" (UniqueName: \"kubernetes.io/projected/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-kube-api-access-wpgcr\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.041025 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.040922 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bec94e6-b67b-4252-9dd3-a7c07a60cb76-workload-socket\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\"" Jul 10 19:47:50.713132 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.713096 2559 generic.go:356] "Generic (PLEG): container finished" podID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerID="592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c" exitCode=0 Jul 10 19:47:50.713324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.713145 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" Jul 10 19:47:50.713324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.713147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerDied","Data":"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c"} Jul 10 19:47:50.713324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.713262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g" event={"ID":"9bec94e6-b67b-4252-9dd3-a7c07a60cb76","Type":"ContainerDied","Data":"a834a04dcd6fb0e7f0556e7e45043e5437ac7bfd5743b27276893cf8123ea013"} Jul 10 19:47:50.713324 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.713293 2559 scope.go:117] "RemoveContainer" containerID="592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c" Jul 10 19:47:50.721602 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.721585 2559 scope.go:117] "RemoveContainer" containerID="59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58" Jul 10 19:47:50.728737 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.728718 2559 scope.go:117] "RemoveContainer" containerID="592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c" Jul 10 19:47:50.728965 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:47:50.728947 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c\": container with ID starting with 592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c not found: ID does not exist" containerID="592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c" Jul 10 19:47:50.729017 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.728973 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c"} err="failed to get container status \"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c\": rpc error: code = NotFound desc = could not find container \"592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c\": container with ID starting with 592dc2807ad3920c4e2ef38053b7ed25622be8bbca199b45b469df6c4b35fe0c not found: ID does not exist" Jul 10 19:47:50.729017 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.728989 2559 scope.go:117] "RemoveContainer" containerID="59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58" Jul 10 19:47:50.729172 ip-10-0-139-14 kubenswrapper[2559]: E0710 19:47:50.729155 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58\": container with ID starting with 59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58 not found: ID does not exist" containerID="59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58" Jul 10 19:47:50.729221 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.729178 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58"} err="failed to get container status \"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58\": rpc error: code = NotFound desc = could not find container \"59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58\": container with ID starting with 59223607a8eea65326dd042a006c3c777d2c9c7c657da8537eba82a4876b8e58 not found: ID does not exist" Jul 10 19:47:50.735769 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.735744 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:47:50.738587 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.738567 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fc4b18-openshift-default-6768769479-ffg8g"] Jul 10 19:47:50.909102 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:50.909068 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" path="/var/lib/kubelet/pods/9bec94e6-b67b-4252-9dd3-a7c07a60cb76/volumes" Jul 10 19:47:51.229249 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:51.229217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d686dc7f-sjw8p_20aafcfd-d8a0-4251-b937-ca3eff683248/copy-manifests/0.log" Jul 10 19:47:51.237222 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:51.237194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d686dc7f-sjw8p_20aafcfd-d8a0-4251-b937-ca3eff683248/manager/0.log" Jul 10 19:47:53.359461 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:53.359425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-r7ttl_14db0466-efcd-4e1a-8756-de532ecec466/limitador/0.log" Jul 10 19:47:54.027918 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:54.027892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2q89b_11e6f587-590f-48fb-83b3-867c920a22f2/discovery/0.log" Jul 10 19:47:55.641705 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:47:55.641672 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7svrx_bb7f60fe-946b-4dc3-8384-7fba313edaee/main/0.log" Jul 10 19:48:02.853706 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:02.853659 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p5pfl_69d39c8f-7477-4279-b330-8c35c7db5c40/global-pull-secret-syncer/0.log" Jul 10 19:48:03.038381 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:03.038349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h52j6_17e67d6e-6944-4d41-93e1-1e4ddd861f24/konnectivity-agent/0.log" Jul 10 19:48:03.118193 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:03.118118 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-14.ec2.internal_51adeb82ef9cf7027b389777ed26ae92/haproxy/0.log" Jul 10 19:48:07.887635 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:07.887605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-r7ttl_14db0466-efcd-4e1a-8756-de532ecec466/limitador/0.log" Jul 10 19:48:09.844428 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:09.844356 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-qgjll_9462828d-f9e7-4f69-a502-8fa96d637fc7/monitoring-plugin/0.log" Jul 10 19:48:09.879929 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:09.879902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48ccn_0d464521-65b3-4d35-a257-80a1b280d418/node-exporter/0.log" Jul 10 19:48:09.907819 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:09.907798 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48ccn_0d464521-65b3-4d35-a257-80a1b280d418/kube-rbac-proxy/0.log" Jul 10 19:48:09.933082 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:09.933060 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48ccn_0d464521-65b3-4d35-a257-80a1b280d418/init-textfile/0.log" Jul 10 19:48:10.165334 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:10.165256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bsjdx_9a428fe2-02ce-404f-8bd7-256fc147dc50/kube-rbac-proxy-main/0.log" Jul 10 19:48:10.187243 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:10.187217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bsjdx_9a428fe2-02ce-404f-8bd7-256fc147dc50/kube-rbac-proxy-self/0.log" Jul 10 19:48:10.219485 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:10.219460 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bsjdx_9a428fe2-02ce-404f-8bd7-256fc147dc50/openshift-state-metrics/0.log" Jul 10 19:48:12.345017 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.344982 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs"] Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345243 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345253 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345271 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345276 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345283 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b52f33a8-55e0-4d86-a578-6c337d0367a5" containerName="main" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345290 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b52f33a8-55e0-4d86-a578-6c337d0367a5" containerName="main" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345341 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345349 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="13a540a7-a683-4606-9e19-7a2d449c643b" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345354 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b52f33a8-55e0-4d86-a578-6c337d0367a5" containerName="main" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345359 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" Jul 10 19:48:12.345366 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.345365 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bec94e6-b67b-4252-9dd3-a7c07a60cb76" containerName="istio-proxy" Jul 10 19:48:12.349636 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.349620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.352219 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.352198 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kffvc\"/\"kube-root-ca.crt\"" Jul 10 19:48:12.353049 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.353032 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kffvc\"/\"default-dockercfg-c6tm2\"" Jul 10 19:48:12.353108 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.353032 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kffvc\"/\"openshift-service-ca.crt\"" Jul 10 19:48:12.360309 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.360287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs"] Jul 10 19:48:12.424074 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.424051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9q67\" (UniqueName: \"kubernetes.io/projected/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-kube-api-access-q9q67\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.424223 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.424085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-proc\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.424223 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.424124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-podres\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.424223 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.424143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-sys\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.424223 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.424171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-lib-modules\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9q67\" (UniqueName: \"kubernetes.io/projected/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-kube-api-access-q9q67\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-proc\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-podres\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-sys\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525237 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-lib-modules\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525390 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-proc\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525390 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525287 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-sys\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525390 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-podres\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.525390 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.525325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-lib-modules\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.534872 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.534841 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9q67\" (UniqueName: \"kubernetes.io/projected/62734b6c-cd11-479b-a7f9-b6a0b8915cb1-kube-api-access-q9q67\") pod \"perf-node-gather-daemonset-dbmhs\" (UID: \"62734b6c-cd11-479b-a7f9-b6a0b8915cb1\") " pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.659492 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.659421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:12.786885 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.786720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs"] Jul 10 19:48:12.789449 ip-10-0-139-14 kubenswrapper[2559]: W0710 19:48:12.789420 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62734b6c_cd11_479b_a7f9_b6a0b8915cb1.slice/crio-50f0396cdaa8c62b5a3ccb57a1b2b6577309284a2daaf26657c9d21dc8a368fd WatchSource:0}: Error finding container 50f0396cdaa8c62b5a3ccb57a1b2b6577309284a2daaf26657c9d21dc8a368fd: Status 404 returned error can't find the container with id 50f0396cdaa8c62b5a3ccb57a1b2b6577309284a2daaf26657c9d21dc8a368fd Jul 10 19:48:12.806535 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:12.806509 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" event={"ID":"62734b6c-cd11-479b-a7f9-b6a0b8915cb1","Type":"ContainerStarted","Data":"50f0396cdaa8c62b5a3ccb57a1b2b6577309284a2daaf26657c9d21dc8a368fd"} Jul 10 19:48:13.817595 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:13.817555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" event={"ID":"62734b6c-cd11-479b-a7f9-b6a0b8915cb1","Type":"ContainerStarted","Data":"5dc40874849a90dbf62320b6d75e55983c4ed26333d774afdb02452c881f06b5"} Jul 10 19:48:13.818006 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:13.817756 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:15.265028 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:15.265000 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwdfp_1bfa3b92-263c-4031-93c0-a312624be68d/dns/0.log" Jul 10 19:48:15.292533 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:15.292506 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lwdfp_1bfa3b92-263c-4031-93c0-a312624be68d/kube-rbac-proxy/0.log" Jul 10 19:48:15.376348 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:15.376319 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2hjm_b451ded7-e536-4987-9bbb-fe41853b21f0/dns-node-resolver/0.log" Jul 10 19:48:15.979088 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:15.979062 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w7hzb_34e26b32-5782-4db5-ba8b-89726914f1eb/node-ca/0.log" Jul 10 19:48:17.003421 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:17.003389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2q89b_11e6f587-590f-48fb-83b3-867c920a22f2/discovery/0.log" Jul 10 19:48:17.872467 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:17.872443 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j89hm_54315897-7804-4b52-833e-30589686936e/serve-healthcheck-canary/0.log" Jul 10 19:48:18.530835 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:18.530809 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6p8_a5e0cfc9-e7a1-4907-9332-aebd4686d10e/kube-rbac-proxy/0.log" Jul 10 19:48:18.554822 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:18.554799 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6p8_a5e0cfc9-e7a1-4907-9332-aebd4686d10e/exporter/0.log" Jul 10 19:48:18.579700 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:18.579676 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6p8_a5e0cfc9-e7a1-4907-9332-aebd4686d10e/extractor/0.log" Jul 10 19:48:19.831326 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:19.831299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" Jul 10 19:48:19.850947 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:19.850881 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kffvc/perf-node-gather-daemonset-dbmhs" podStartSLOduration=7.85086098 podStartE2EDuration="7.85086098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:48:13.833526927 +0000 UTC m=+2431.534878032" watchObservedRunningTime="2026-07-10 19:48:19.85086098 +0000 UTC m=+2437.552212086" Jul 10 19:48:21.490784 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:21.490672 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d686dc7f-sjw8p_20aafcfd-d8a0-4251-b937-ca3eff683248/manager/0.log" Jul 10 19:48:21.522741 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:21.522713 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d686dc7f-sjw8p_20aafcfd-d8a0-4251-b937-ca3eff683248/copy-manifests/0.log" Jul 10 19:48:22.955275 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:22.955245 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d6cfdfcb9-vb9v7_53d4574b-9bda-4e1d-9c70-98274a687bb7/manager/0.log" Jul 10 19:48:22.985339 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:22.985302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6l4sb_99040977-24c5-4c51-94e8-3cde325379d3/openshift-lws-operator/0.log" Jul 10 19:48:23.020529 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:23.020504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2q89b_11e6f587-590f-48fb-83b3-867c920a22f2/discovery/0.log" Jul 10 19:48:24.473952 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:24.473922 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2q89b_11e6f587-590f-48fb-83b3-867c920a22f2/discovery/0.log" Jul 10 19:48:29.666636 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:29.666605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxl8l_ca29e373-6e15-43a3-83ee-750ee0e1cfaa/kube-multus-additional-cni-plugins/0.log" Jul 10 19:48:29.688578 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:29.688549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxl8l_ca29e373-6e15-43a3-83ee-750ee0e1cfaa/egress-router-binary-copy/0.log" Jul 10 19:48:29.713358 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:29.713332 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxl8l_ca29e373-6e15-43a3-83ee-750ee0e1cfaa/cni-plugins/0.log" Jul 10 19:48:29.738095 ip-10-0-139-14 kubenswrapper[2559]: I0710 19:48:29.738073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dxl8l_ca29e373-6e15-43a3-83ee-750ee0e1cfaa/bond-cni-plugin/0.log"