Jul 20 15:50:22.938425 ip-10-0-138-33 systemd[1]: Starting Kubernetes Kubelet... Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.338843 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346085 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346101 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346105 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346108 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346112 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346115 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346118 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.349727 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346121 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346123 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346126 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346129 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346132 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346135 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346138 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346140 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346142 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346145 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346148 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346170 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346175 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346178 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346181 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346184 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346187 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346190 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346193 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346195 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.402402 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346198 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346201 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346204 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346207 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346209 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346222 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346225 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346228 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346230 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346235 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346239 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346243 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346246 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346249 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346252 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346255 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346258 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346262 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346266 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346269 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.433112 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346272 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.416475 ip-10-0-138-33 systemd[1]: Started Kubernetes Kubelet. Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346274 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346277 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346280 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346285 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346288 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346291 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346294 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346297 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346299 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346302 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346304 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346307 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346310 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346313 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346316 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346318 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346321 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346323 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346326 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.666699 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346328 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346331 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346334 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346338 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346341 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346344 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346348 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346351 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346354 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346357 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346359 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346362 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346365 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346368 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346370 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346373 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346377 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346379 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346382 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.675063 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346385 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346387 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346389 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346392 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346395 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346397 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346401 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346403 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346406 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346409 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346412 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346414 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.346417 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347186 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347196 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347201 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347205 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347208 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347211 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.675818 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347214 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347217 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347220 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347224 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347226 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347229 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347232 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347234 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347237 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347239 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347242 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347246 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347249 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347252 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347255 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347258 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347260 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347263 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347266 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347269 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.676493 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347271 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347274 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347277 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347280 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347282 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347285 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347288 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347290 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347293 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347296 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347299 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347302 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347305 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347307 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347310 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347313 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347316 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347319 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347321 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347324 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.677083 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347326 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347329 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347332 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347335 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347338 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347341 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347343 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347347 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347350 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347352 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347355 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347358 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347360 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347363 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347366 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347369 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347371 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347374 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347377 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347380 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.677729 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347385 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347388 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347392 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347395 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347398 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347401 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347403 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347406 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347410 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347414 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347417 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347420 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347422 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347425 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347428 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347433 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347436 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347440 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.678340 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347444 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347448 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347451 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347454 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347456 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347459 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347462 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347465 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347467 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347470 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347473 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347475 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347478 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347480 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.347484 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348032 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348043 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348048 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348052 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348058 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.679002 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348062 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348067 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348071 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348075 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348079 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348084 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348088 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348092 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348096 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348100 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348104 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348108 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348114 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348120 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348124 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348128 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348132 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348136 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348140 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.679635 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348144 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348148 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348171 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348176 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348180 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348183 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348187 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348193 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348196 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348200 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348203 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348207 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348211 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348215 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348218 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348221 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348224 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348228 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348231 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348235 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.680265 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348240 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348243 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348246 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348249 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348253 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348257 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348260 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348263 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348266 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348270 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348273 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348276 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348279 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348282 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348286 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348289 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348292 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348295 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348298 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348302 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.681096 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348305 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348309 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348312 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348315 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348318 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348321 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348324 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348327 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348330 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348334 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348337 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348340 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348347 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348350 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348354 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348357 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348360 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348363 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348367 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348370 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.681920 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348373 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348377 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348380 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348383 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348387 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348390 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348394 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348397 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348400 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348402 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348414 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348420 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348423 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348426 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.348431 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348502 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348510 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348519 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348530 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348535 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 15:50:23.682524 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348538 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348543 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348547 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348551 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348555 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348558 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348562 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348565 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348568 2585 flags.go:64] FLAG: --cgroup-root="" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348571 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348573 2585 flags.go:64] FLAG: --client-ca-file="" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348577 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348580 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348584 2585 flags.go:64] FLAG: --cluster-domain="" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348588 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348591 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348594 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348597 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348603 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348608 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348611 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348614 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348617 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348622 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 15:50:23.683138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348625 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348628 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348630 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348635 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348638 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348641 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348644 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348647 2585 flags.go:64] FLAG: --enable-server="true" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348650 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348655 2585 flags.go:64] FLAG: --event-burst="100" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348658 2585 flags.go:64] FLAG: --event-qps="50" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348661 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348666 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348669 2585 flags.go:64] FLAG: --eviction-hard="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348673 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348676 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348679 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348682 2585 flags.go:64] FLAG: --eviction-soft="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348685 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348688 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348691 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348695 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348698 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348700 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348703 2585 flags.go:64] FLAG: --feature-gates="" Jul 20 15:50:23.683756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348707 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348710 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348713 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348716 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348719 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348722 2585 flags.go:64] FLAG: --help="false" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348726 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348730 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348732 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348735 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348739 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348742 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348745 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348748 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348751 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348754 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348756 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348760 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348762 2585 flags.go:64] FLAG: --kube-reserved="" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348767 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348770 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348773 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348776 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348779 2585 flags.go:64] FLAG: --lock-file="" Jul 20 15:50:23.684451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348781 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348784 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348787 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348793 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348796 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348799 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348802 2585 flags.go:64] FLAG: --logging-format="text" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348805 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348808 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348813 2585 flags.go:64] FLAG: --manifest-url="" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348817 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348822 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348825 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348829 2585 flags.go:64] FLAG: --max-pods="110" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348833 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348836 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348839 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348842 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348845 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348848 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348850 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348858 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348861 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348864 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 15:50:23.685075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348867 2585 flags.go:64] FLAG: --pod-cidr="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348870 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348876 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348879 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348884 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348887 2585 flags.go:64] FLAG: --port="10250" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348890 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348893 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07bee6a30d8637d6f" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348897 2585 flags.go:64] FLAG: --qos-reserved="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348900 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348902 2585 flags.go:64] FLAG: --register-node="true" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348905 2585 flags.go:64] FLAG: --register-with-taints="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348909 2585 flags.go:64] FLAG: --registry-burst="10" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348913 2585 flags.go:64] FLAG: --registry-qps="5" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348915 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348918 2585 flags.go:64] FLAG: --reserved-memory="" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348922 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348925 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348928 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348930 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348933 2585 flags.go:64] FLAG: --runonce="false" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348936 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348940 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348943 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348946 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 15:50:23.685756 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348949 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348952 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348955 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348958 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348961 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348963 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348966 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348969 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348972 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348975 2585 flags.go:64] FLAG: --system-cgroups="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348978 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348985 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348987 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348991 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348994 2585 flags.go:64] FLAG: --tls-min-version="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.348997 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349000 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349003 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349006 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349008 2585 flags.go:64] FLAG: --v="2" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349012 2585 flags.go:64] FLAG: --version="false" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349017 2585 flags.go:64] FLAG: --vmodule="" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349020 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.349024 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349145 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.686465 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349149 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349168 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349173 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349176 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349180 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349183 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349186 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349188 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349191 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349194 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349196 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349199 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349202 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349204 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349207 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349210 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349212 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349215 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349219 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349221 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.687220 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349224 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349227 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349229 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349240 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349243 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349246 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349248 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349251 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349254 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349263 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349266 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349268 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349271 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349273 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349276 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349278 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349283 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349286 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349288 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349291 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.688208 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349293 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349296 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349299 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349301 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349305 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349309 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349312 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349315 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349318 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349320 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349324 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349327 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349329 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349332 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349334 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349337 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349340 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349342 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349345 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.688776 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349347 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349350 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349353 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349356 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349358 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349360 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349363 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349365 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349368 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349371 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349374 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349378 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349382 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349384 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349387 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349390 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349392 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349395 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349397 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349400 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.848362 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349402 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349405 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349407 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349411 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349413 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349416 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349418 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349422 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349426 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349429 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349432 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349435 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349438 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349441 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349444 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349448 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349453 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349456 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.849051 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.349459 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.350099 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.356772 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.356789 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.356813 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.356820 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356874 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356879 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356883 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356886 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356889 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356892 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356895 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356898 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.849561 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356901 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356905 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356909 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356912 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356914 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356917 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356920 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356923 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356926 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356929 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356932 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356935 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356937 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356940 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356943 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356946 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356949 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356952 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356955 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356958 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.850000 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356961 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356965 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356968 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356970 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356973 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356976 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356979 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356981 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356984 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356988 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356991 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356994 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356996 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.356999 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357002 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357004 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357007 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357010 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357012 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357015 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.850558 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357018 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357020 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357024 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357027 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357030 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357032 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357035 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357038 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357041 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357043 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357046 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357049 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357051 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357054 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357057 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357060 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357063 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357065 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357068 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357070 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.851125 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357073 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357076 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357078 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357081 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357083 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357086 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357089 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357091 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357095 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357099 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357103 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357106 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357109 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357111 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357117 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357120 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357122 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357125 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357128 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.851674 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357130 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357133 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357136 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357139 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357141 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357144 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357146 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357149 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357170 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357174 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357177 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357180 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.357185 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357320 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357327 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 15:50:23.852374 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357330 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357333 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357337 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357340 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357342 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357345 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357348 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357350 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357353 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357355 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357358 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357361 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357365 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357370 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357372 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357375 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357378 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357380 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357383 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 15:50:23.852779 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357385 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357388 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357390 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357393 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357395 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357398 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357401 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357404 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357406 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357409 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357412 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357414 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357417 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357419 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357422 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357424 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357427 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357429 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357432 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357434 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 15:50:23.853333 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357437 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357439 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357442 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357444 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357447 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357451 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357455 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357457 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357460 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357464 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357467 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357470 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357472 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357475 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357477 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357480 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357482 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357485 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357487 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 15:50:23.853856 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357490 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357493 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357496 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357498 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357502 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357505 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357508 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357511 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357514 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357517 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357520 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357522 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357525 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357528 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357530 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357533 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357535 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357538 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357542 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 15:50:23.854415 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357546 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357549 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357551 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357554 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357556 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357559 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357562 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357564 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357566 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357569 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357572 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357574 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357577 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357580 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357583 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357593 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357597 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357599 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357602 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 15:50:23.854928 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:23.357605 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.357611 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.357741 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.360640 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.361867 2585 server.go:1019] "Starting client certificate rotation" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.361977 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.362021 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.364825 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.369181 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.382402 2585 log.go:25] "Validated CRI v1 runtime API" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.385291 2585 log.go:25] "Validated CRI v1 image API" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.387392 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 15:50:23.855468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.390353 2585 fs.go:135] Filesystem UUIDs: map[33f9fb9a-b6ef-4830-ab39-c566fd05321b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a30184ed-3516-4359-bae2-b540b6fec3f0:/dev/nvme0n1p3] Jul 20 15:50:23.855832 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.390369 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 15:50:23.855832 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.393688 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.395730 2585 manager.go:216] Machine: {Timestamp:2026-07-20 15:50:23.394020506 +0000 UTC m=+0.340476153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100894 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a894231ed8c3d1c7623558db14fb SystemUUID:ec26a894-231e-d8c3-d1c7-623558db14fb BootID:446f317c-db43-4bc2-9980-7aea40dd1ac2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:e7:91:eb:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:e7:91:eb:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:ec:68:35:88:9c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.395832 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.395915 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.398838 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.398873 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.399595 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.399607 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.399615 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.400268 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.401393 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404181 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404307 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404338 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404351 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404367 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404378 2585 kubelet.go:398] "Adding apiserver pod source" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404391 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 15:50:23.856000 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404765 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.404785 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.408378 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.410301 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.410328 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411358 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411372 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411378 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411383 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411392 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411397 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411404 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411409 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411416 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411421 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411429 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.411434 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.412104 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.412111 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.414753 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.415264 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.415264 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.415694 2585 server.go:1268] "Started kubelet" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.416112 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.417925 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.418795 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.418837 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.420325 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.424845 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.426809 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-33.ec2.internal.18c40a40402153e6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-33.ec2.internal,UID:ip-10-0-138-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-33.ec2.internal,},FirstTimestamp:2026-07-20 15:50:23.415669734 +0000 UTC m=+0.362125371,LastTimestamp:2026-07-20 15:50:23.415669734 +0000 UTC m=+0.362125371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-33.ec2.internal,}" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.428481 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.428472 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.428601 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429174 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429195 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429175 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429344 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429354 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429430 2585 factory.go:55] Registering systemd factory Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429443 2585 factory.go:223] Registration of the systemd container factory successfully Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429660 2585 factory.go:153] Registering CRI-O factory Jul 20 15:50:23.856555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429672 2585 factory.go:223] Registration of the crio container factory successfully Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429725 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429751 2585 factory.go:103] Registering Raw factory Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.429766 2585 manager.go:1196] Started watching for new ooms in manager Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.430145 2585 manager.go:349] Starting recovery of all containers Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.433037 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.433473 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.441106 2585 manager.go:354] Recovery completed Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.445405 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.447398 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.447433 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.447446 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.448036 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.448189 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.448199 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.448213 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.448345 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfsjb" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.449270 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-33.ec2.internal.18c40a404205be32 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-33.ec2.internal,UID:ip-10-0-138-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-33.ec2.internal,},FirstTimestamp:2026-07-20 15:50:23.44741637 +0000 UTC m=+0.393872019,LastTimestamp:2026-07-20 15:50:23.44741637 +0000 UTC m=+0.393872019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-33.ec2.internal,}" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.449425 2585 policy_none.go:49] "None policy: Start" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.449440 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.449454 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.449975 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.450001 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.450012 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.450368 2585 policy_none.go:47] "Start" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.455685 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qfsjb" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.461080 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-33.ec2.internal.18c40a4042061d8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-33.ec2.internal,UID:ip-10-0-138-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-33.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-33.ec2.internal,},FirstTimestamp:2026-07-20 15:50:23.447440781 +0000 UTC m=+0.393896427,LastTimestamp:2026-07-20 15:50:23.447440781 +0000 UTC m=+0.393896427,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-33.ec2.internal,}" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.504685 2585 manager.go:337] "Starting Device Plugin manager" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.504720 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.504730 2585 server.go:87] "Starting device plugin registration server" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.504993 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.505005 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 15:50:23.857647 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.505106 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.505196 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.505204 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.505721 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.505763 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.532807 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.533975 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.534013 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.534040 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.534076 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.535765 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.605959 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.607029 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.607057 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.607066 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.607092 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.616743 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.616765 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-33.ec2.internal\": node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.635017 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal"] Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.635082 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.636631 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.636657 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.636673 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638186 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638246 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638272 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638929 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638947 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638956 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.638931 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.639017 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.639026 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.640202 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.640235 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.641026 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.641051 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.641076 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.649252 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.689021 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.693549 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.992546 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.749515 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.831147 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.831206 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.831261 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.850229 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.931910 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.931963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.931982 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.932016 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.932021 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.932021 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:23.951593 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:23.994642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.993647 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:24.169894 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:23.997618 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:24.169894 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.052778 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.169894 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.153773 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.347534 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.254340 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.347534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.316392 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:24.347534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.336728 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.355190 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.361331 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.361453 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.361479 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.361505 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.456134 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.459362 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 15:45:24 +0000 UTC" deadline="2027-12-19 10:05:54.575953367 +0000 UTC" Jul 20 15:50:24.499185 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.459396 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12402h15m30.116561487s" Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.557028 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:24.608563 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6d814b9e1fe3f97302765f12ed4851.slice/crio-ad0118b9dd24aae808662cf6bbb298a78eb37ed7514a4b21646db72feaf443c5 WatchSource:0}: Error finding container ad0118b9dd24aae808662cf6bbb298a78eb37ed7514a4b21646db72feaf443c5: Status 404 returned error can't find the container with id ad0118b9dd24aae808662cf6bbb298a78eb37ed7514a4b21646db72feaf443c5 Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:24.608787 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31783b4ed77dfc64030a66f386750024.slice/crio-87d8dacd3737af48bd4b742563fa4c49fa8a1bcd91d3aee1bb6c473cbeb244f2 WatchSource:0}: Error finding container 87d8dacd3737af48bd4b742563fa4c49fa8a1bcd91d3aee1bb6c473cbeb244f2: Status 404 returned error can't find the container with id 87d8dacd3737af48bd4b742563fa4c49fa8a1bcd91d3aee1bb6c473cbeb244f2 Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.615449 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.623743 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.624656 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.624684 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 15:50:24.634740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.624694 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 20 15:50:24.785931 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.658100 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.785931 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.759258 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:24.950312 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.860057 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:24.961030 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:24.994792 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.030127 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.043806 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.044884 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 20 15:50:25.127062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.055682 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 15:50:25.263436 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.193360 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.405210 2585 apiserver.go:52] "Watching apiserver" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.414599 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.416362 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-z7z48","openshift-multus/multus-t962q","kube-system/global-pull-secret-syncer-6nfmm","openshift-cluster-node-tuning-operator/tuned-jzks9","openshift-multus/network-metrics-daemon-zkqjw","openshift-network-diagnostics/network-check-target-vqlgj","openshift-network-operator/iptables-alerter-qv6kt","openshift-ovn-kubernetes/ovnkube-node-vgj6v","kube-system/konnectivity-agent-btmvz","kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4","openshift-dns/node-resolver-z99gh","openshift-image-registry/node-ca-9td84","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal"] Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.419408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.420113 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t962q" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.421307 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.421387 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.422441 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.422783 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.422863 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.422886 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423039 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423131 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8x5sk\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423327 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423354 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423516 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ctmzv\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.423795 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.423842 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.425141 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.425221 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.426191 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.426438 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hf8bp\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.426588 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.426640 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.427481 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.428921 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.429122 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-95ztr\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.429471 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.429739 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.429920 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 15:50:25.442509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.429933 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430297 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430514 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lwk2q\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430558 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430668 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430826 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.430978 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.431129 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.431460 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.434679 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.434912 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-75fhk\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.437408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.439129 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.439352 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.439530 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nbf4b\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.439720 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.441365 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.441964 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.441996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-node-log\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442024 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-env-overrides\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442048 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-socket-dir-parent\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-host\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442097 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-etc-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442120 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysconfig\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442144 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:25.444111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442171 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51da579-40b6-4cec-8c25-cfa7c6dafc91-agent-certs\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442198 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmglt\" (UniqueName: \"kubernetes.io/projected/f6897515-482b-4c90-8bba-76d8533280be-kube-api-access-cmglt\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-log-socket\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442262 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovn-node-metrics-cert\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-multus-certs\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442310 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-kubernetes\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-run\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-os-release\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442375 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-slash\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442402 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-bin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442428 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442451 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-system-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442474 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-kubelet\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442499 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cnibin\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442523 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-kubelet\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442547 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-ovn\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.446930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442572 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-bin\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442603 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442629 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-script-lib\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442673 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-cni-binary-copy\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442698 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-systemd-units\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442721 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-netns\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442745 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-var-lib-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442770 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-k8s-cni-cncf-io\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-conf-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442827 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-conf\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442874 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-systemd\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-sys\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442950 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442977 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdcq6\" (UniqueName: \"kubernetes.io/projected/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-kube-api-access-cdcq6\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443019 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef623006-45c5-48e1-a7bf-463fc77a82ed-tmp-dir\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443155 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-lib-modules\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.448388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443185 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-tmp\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443217 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.442893 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443410 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k225z\" (UniqueName: \"kubernetes.io/projected/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-kube-api-access-k225z\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443434 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-cnibin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443462 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443497 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c7x\" (UniqueName: \"kubernetes.io/projected/ef623006-45c5-48e1-a7bf-463fc77a82ed-kube-api-access-t7c7x\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443523 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-system-cni-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443548 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443573 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9c7cd\"" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443571 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-kubelet-config\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443618 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-systemd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443642 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-config\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443664 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443690 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-multus\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443782 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-host\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443819 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.451784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443847 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443879 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-modprobe-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443904 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-var-lib-kubelet\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443929 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-etc-tuned\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-serviceca\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.443992 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-dbus\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-netd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444079 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef623006-45c5-48e1-a7bf-463fc77a82ed-hosts-file\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-etc-kubernetes\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzw5\" (UniqueName: \"kubernetes.io/projected/dad3ef21-b04e-4226-a03c-a151dd3fd47c-kube-api-access-jdzw5\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444225 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-netns\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444260 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-hostroot\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444287 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-daemon-config\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444320 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p5mq\" (UniqueName: \"kubernetes.io/projected/dc7432ba-73e0-423e-8a56-d331efb1316e-kube-api-access-2p5mq\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444356 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51da579-40b6-4cec-8c25-cfa7c6dafc91-konnectivity-ca\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444389 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk96v\" (UniqueName: \"kubernetes.io/projected/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-kube-api-access-wk96v\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.452736 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444427 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.455975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-os-release\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.455975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444840 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 15:50:25.455975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.444868 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s9vx6\"" Jul 20 15:50:25.455975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.447181 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 15:50:25.455975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.447325 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:25.526020 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.464743 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq8lz" Jul 20 15:50:25.526020 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.472386 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq8lz" Jul 20 15:50:25.530208 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.530067 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545405 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-multus-certs\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-kubernetes\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-run\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545489 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-os-release\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545509 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-slash\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545510 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-multus-certs\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545531 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-bin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545572 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-bin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-system-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-kubelet\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cnibin\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545648 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-os-release\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545667 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-kubelet\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545682 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-slash\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545689 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-ovn\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-bin\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.622157 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545717 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-kubelet\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545733 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545740 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-kubelet\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545756 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-script-lib\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545665 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-run\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545786 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-cni-binary-copy\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545808 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-ovn\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545816 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvd9\" (UniqueName: \"kubernetes.io/projected/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-kube-api-access-xcvd9\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545842 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-systemd-units\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545861 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-system-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-netns\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545870 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545708 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-kubernetes\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545892 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-var-lib-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545843 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-bin\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-k8s-cni-cncf-io\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.627563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545936 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-conf-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545940 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-var-lib-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545958 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-conf\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545973 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-k8s-cni-cncf-io\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545977 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-systemd\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.545894 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-netns\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546006 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-sys\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546014 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-systemd\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdcq6\" (UniqueName: \"kubernetes.io/projected/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-kube-api-access-cdcq6\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef623006-45c5-48e1-a7bf-463fc77a82ed-tmp-dir\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546048 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-conf-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgf5\" (UniqueName: \"kubernetes.io/projected/0412910f-f78e-408c-b89b-3ed0e8d7d517-kube-api-access-hwgf5\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-lib-modules\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-tmp\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546187 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysctl-conf\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.628546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546192 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k225z\" (UniqueName: \"kubernetes.io/projected/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-kube-api-access-k225z\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-cnibin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546252 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546273 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c7x\" (UniqueName: \"kubernetes.io/projected/ef623006-45c5-48e1-a7bf-463fc77a82ed-kube-api-access-t7c7x\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546295 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-sys-fs\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546318 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-system-cni-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-kubelet-config\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546385 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-systemd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-config\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546445 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546452 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-cni-binary-copy\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-multus\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546484 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef623006-45c5-48e1-a7bf-463fc77a82ed-tmp-dir\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546489 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-host\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546514 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546529 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cnibin\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.629502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-modprobe-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-var-lib-kubelet\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546603 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-sys\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546604 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-etc-tuned\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546636 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-serviceca\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546672 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-dbus\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546695 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-netd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546716 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef623006-45c5-48e1-a7bf-463fc77a82ed-hosts-file\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546738 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-etc-kubernetes\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546759 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzw5\" (UniqueName: \"kubernetes.io/projected/dad3ef21-b04e-4226-a03c-a151dd3fd47c-kube-api-access-jdzw5\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546795 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-netns\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546816 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-hostroot\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546837 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-daemon-config\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546858 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p5mq\" (UniqueName: \"kubernetes.io/projected/dc7432ba-73e0-423e-8a56-d331efb1316e-kube-api-access-2p5mq\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51da579-40b6-4cec-8c25-cfa7c6dafc91-konnectivity-ca\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546913 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk96v\" (UniqueName: \"kubernetes.io/projected/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-kube-api-access-wk96v\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546940 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.630642 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546953 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-script-lib\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546962 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-os-release\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547006 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-os-release\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-kubelet-config\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547398 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-serviceca\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547406 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-lib-modules\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547528 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb63bde8-6d03-403d-8886-7b806aa6ca33-dbus\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-cni-netd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547601 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef623006-45c5-48e1-a7bf-463fc77a82ed-hosts-file\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547631 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-etc-kubernetes\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-run-netns\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547900 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-hostroot\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547903 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547760 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548406 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-system-cni-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548188 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548587 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f51da579-40b6-4cec-8c25-cfa7c6dafc91-konnectivity-ca\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548812 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.716321 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548816 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.547006 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-socket-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548862 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548883 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-node-log\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548904 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-env-overrides\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548926 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-socket-dir-parent\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548949 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548972 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-iptables-alerter-script\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548994 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-host\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549019 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-etc-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549043 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysconfig\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549091 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549112 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51da579-40b6-4cec-8c25-cfa7c6dafc91-agent-certs\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549133 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-registration-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549124 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-daemon-config\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549155 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-device-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.718012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549178 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-host-slash\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmglt\" (UniqueName: \"kubernetes.io/projected/f6897515-482b-4c90-8bba-76d8533280be-kube-api-access-cmglt\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549220 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-log-socket\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.549222 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovn-node-metrics-cert\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.549314 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:26.049282756 +0000 UTC m=+2.995738391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549468 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-systemd\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549649 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-host-var-lib-cni-multus\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549757 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-cni-dir\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549806 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-host\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.546563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-systemd-units\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549854 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovnkube-config\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549865 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-run-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549956 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-modprobe-d\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.549994 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-node-log\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.550066 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.550119 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:26.050103356 +0000 UTC m=+2.996558994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:25.718972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550143 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dad3ef21-b04e-4226-a03c-a151dd3fd47c-env-overrides\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-multus-socket-dir-parent\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550192 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-host\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-etc-openvswitch\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550288 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-var-lib-kubelet\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.548081 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc7432ba-73e0-423e-8a56-d331efb1316e-cnibin\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550345 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6897515-482b-4c90-8bba-76d8533280be-etc-sysconfig\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550538 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dad3ef21-b04e-4226-a03c-a151dd3fd47c-log-socket\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.550727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.553871 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"31783b4ed77dfc64030a66f386750024","Type":"ContainerStarted","Data":"87d8dacd3737af48bd4b742563fa4c49fa8a1bcd91d3aee1bb6c473cbeb244f2"} Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.554476 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dad3ef21-b04e-4226-a03c-a151dd3fd47c-ovn-node-metrics-cert\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.554597 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-etc-tuned\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.558693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k225z\" (UniqueName: \"kubernetes.io/projected/d6cfd7db-a1f8-4cd7-b99b-fca34c24987d-kube-api-access-k225z\") pod \"node-ca-9td84\" (UID: \"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d\") " pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.558747 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f51da579-40b6-4cec-8c25-cfa7c6dafc91-agent-certs\") pod \"konnectivity-agent-btmvz\" (UID: \"f51da579-40b6-4cec-8c25-cfa7c6dafc91\") " pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.559492 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6897515-482b-4c90-8bba-76d8533280be-tmp\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.560724 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdcq6\" (UniqueName: \"kubernetes.io/projected/1f0ffbaa-9934-4bd0-9369-f747f9d2ab71-kube-api-access-cdcq6\") pod \"multus-additional-cni-plugins-z7z48\" (UID: \"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71\") " pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.560924 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.560951 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:25.720108 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.560965 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:25.561077 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:26.061017049 +0000 UTC m=+3.007472711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.562141 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerStarted","Data":"ad0118b9dd24aae808662cf6bbb298a78eb37ed7514a4b21646db72feaf443c5"} Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.563888 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p5mq\" (UniqueName: \"kubernetes.io/projected/dc7432ba-73e0-423e-8a56-d331efb1316e-kube-api-access-2p5mq\") pod \"multus-t962q\" (UID: \"dc7432ba-73e0-423e-8a56-d331efb1316e\") " pod="openshift-multus/multus-t962q" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.564120 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzw5\" (UniqueName: \"kubernetes.io/projected/dad3ef21-b04e-4226-a03c-a151dd3fd47c-kube-api-access-jdzw5\") pod \"ovnkube-node-vgj6v\" (UID: \"dad3ef21-b04e-4226-a03c-a151dd3fd47c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.564700 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmglt\" (UniqueName: \"kubernetes.io/projected/f6897515-482b-4c90-8bba-76d8533280be-kube-api-access-cmglt\") pod \"tuned-jzks9\" (UID: \"f6897515-482b-4c90-8bba-76d8533280be\") " pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.569758 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk96v\" (UniqueName: \"kubernetes.io/projected/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-kube-api-access-wk96v\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.570390 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c7x\" (UniqueName: \"kubernetes.io/projected/ef623006-45c5-48e1-a7bf-463fc77a82ed-kube-api-access-t7c7x\") pod \"node-resolver-z99gh\" (UID: \"ef623006-45c5-48e1-a7bf-463fc77a82ed\") " pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650604 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-socket-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650661 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650689 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-iptables-alerter-script\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-registration-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650784 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-device-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-socket-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.721973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650842 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-device-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650851 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650920 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-host-slash\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650940 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-registration-dir\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650972 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-host-slash\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.650980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvd9\" (UniqueName: \"kubernetes.io/projected/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-kube-api-access-xcvd9\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.651010 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgf5\" (UniqueName: \"kubernetes.io/projected/0412910f-f78e-408c-b89b-3ed0e8d7d517-kube-api-access-hwgf5\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.651033 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-sys-fs\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.651100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0412910f-f78e-408c-b89b-3ed0e8d7d517-sys-fs\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.651427 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-iptables-alerter-script\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.660963 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvd9\" (UniqueName: \"kubernetes.io/projected/a466a462-4e6b-4d37-b69e-c6b2e7fc92da-kube-api-access-xcvd9\") pod \"iptables-alerter-qv6kt\" (UID: \"a466a462-4e6b-4d37-b69e-c6b2e7fc92da\") " pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:25.722740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.665897 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgf5\" (UniqueName: \"kubernetes.io/projected/0412910f-f78e-408c-b89b-3ed0e8d7d517-kube-api-access-hwgf5\") pod \"aws-ebs-csi-driver-node-x6td4\" (UID: \"0412910f-f78e-408c-b89b-3ed0e8d7d517\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.736937 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.736881 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z99gh" Jul 20 15:50:25.747118 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.747081 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef623006_45c5_48e1_a7bf_463fc77a82ed.slice/crio-4dac1767002802dc4db5ebe049bcb18e5dfc7525f1c8abdadb6a0099982cdafb WatchSource:0}: Error finding container 4dac1767002802dc4db5ebe049bcb18e5dfc7525f1c8abdadb6a0099982cdafb: Status 404 returned error can't find the container with id 4dac1767002802dc4db5ebe049bcb18e5dfc7525f1c8abdadb6a0099982cdafb Jul 20 15:50:25.751687 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.751648 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t962q" Jul 20 15:50:25.760423 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.760391 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7432ba_73e0_423e_8a56_d331efb1316e.slice/crio-8afa7efb075a6bc9a3a80331b38701283b92ce1335b707e15465610c5d4b3b48 WatchSource:0}: Error finding container 8afa7efb075a6bc9a3a80331b38701283b92ce1335b707e15465610c5d4b3b48: Status 404 returned error can't find the container with id 8afa7efb075a6bc9a3a80331b38701283b92ce1335b707e15465610c5d4b3b48 Jul 20 15:50:25.762732 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.762638 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jzks9" Jul 20 15:50:25.771899 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.771865 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6897515_482b_4c90_8bba_76d8533280be.slice/crio-56319b89e3eb7298b993dca697fc64a54a36044e10a6902fb224351e9c1e77ac WatchSource:0}: Error finding container 56319b89e3eb7298b993dca697fc64a54a36044e10a6902fb224351e9c1e77ac: Status 404 returned error can't find the container with id 56319b89e3eb7298b993dca697fc64a54a36044e10a6902fb224351e9c1e77ac Jul 20 15:50:25.772003 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.771925 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7z48" Jul 20 15:50:25.780443 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.780411 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:25.781111 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.781085 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0ffbaa_9934_4bd0_9369_f747f9d2ab71.slice/crio-2620622bc0ef7ee433f83fd6192a7e7eef2006a25019ee3593532b015daa6179 WatchSource:0}: Error finding container 2620622bc0ef7ee433f83fd6192a7e7eef2006a25019ee3593532b015daa6179: Status 404 returned error can't find the container with id 2620622bc0ef7ee433f83fd6192a7e7eef2006a25019ee3593532b015daa6179 Jul 20 15:50:25.789723 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.789695 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad3ef21_b04e_4226_a03c_a151dd3fd47c.slice/crio-c6fee635efb17463ed1905a7b492dafb3e7e7c158c8632505d3dde256642a19e WatchSource:0}: Error finding container c6fee635efb17463ed1905a7b492dafb3e7e7c158c8632505d3dde256642a19e: Status 404 returned error can't find the container with id c6fee635efb17463ed1905a7b492dafb3e7e7c158c8632505d3dde256642a19e Jul 20 15:50:25.791798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.791757 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:25.801576 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.801540 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51da579_40b6_4cec_8c25_cfa7c6dafc91.slice/crio-0f49546c8c073b39ff8c6382b4d3f61357920a5a824bb60d159198e7d8922894 WatchSource:0}: Error finding container 0f49546c8c073b39ff8c6382b4d3f61357920a5a824bb60d159198e7d8922894: Status 404 returned error can't find the container with id 0f49546c8c073b39ff8c6382b4d3f61357920a5a824bb60d159198e7d8922894 Jul 20 15:50:25.801692 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.801587 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9td84" Jul 20 15:50:25.812541 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.812501 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cfd7db_a1f8_4cd7_b99b_fca34c24987d.slice/crio-7fa15d8c64d017949881118a0b615039985343faa2f97ca092c6f21e71387ba4 WatchSource:0}: Error finding container 7fa15d8c64d017949881118a0b615039985343faa2f97ca092c6f21e71387ba4: Status 404 returned error can't find the container with id 7fa15d8c64d017949881118a0b615039985343faa2f97ca092c6f21e71387ba4 Jul 20 15:50:25.814109 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.814087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" Jul 20 15:50:25.826214 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:25.826011 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0412910f_f78e_408c_b89b_3ed0e8d7d517.slice/crio-ca5ea3e71752bee64999e8e3689cd928796e46e3a882d9666a245e6e3f3c0d0b WatchSource:0}: Error finding container ca5ea3e71752bee64999e8e3689cd928796e46e3a882d9666a245e6e3f3c0d0b: Status 404 returned error can't find the container with id ca5ea3e71752bee64999e8e3689cd928796e46e3a882d9666a245e6e3f3c0d0b Jul 20 15:50:25.852327 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:25.852278 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv6kt" Jul 20 15:50:26.054464 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.054359 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:26.054635 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.054462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:26.054635 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.054553 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:26.054635 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.054600 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:26.054635 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.054637 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:27.054617129 +0000 UTC m=+4.001072762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:26.054819 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.054655 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:27.054647678 +0000 UTC m=+4.001103312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:26.155783 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.155742 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:26.155978 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.155955 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:26.156043 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.155987 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:26.156043 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.156001 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:26.156158 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.156082 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:27.156056968 +0000 UTC m=+4.102512621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:26.206970 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:50:26.206933 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda466a462_4e6b_4d37_b69e_c6b2e7fc92da.slice/crio-ee76d6e0e00302f370553e3aab094233b18c13ce203d6e8b892d86021a406460 WatchSource:0}: Error finding container ee76d6e0e00302f370553e3aab094233b18c13ce203d6e8b892d86021a406460: Status 404 returned error can't find the container with id ee76d6e0e00302f370553e3aab094233b18c13ce203d6e8b892d86021a406460 Jul 20 15:50:26.475059 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.474962 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:45:26 +0000 UTC" deadline="2028-04-12 12:49:33.506683818 +0000 UTC" Jul 20 15:50:26.475059 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.475000 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15164h59m7.03168898s" Jul 20 15:50:26.534503 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.534464 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:26.535205 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:26.534615 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:26.564760 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.564723 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv6kt" event={"ID":"a466a462-4e6b-4d37-b69e-c6b2e7fc92da","Type":"ContainerStarted","Data":"ee76d6e0e00302f370553e3aab094233b18c13ce203d6e8b892d86021a406460"} Jul 20 15:50:26.565930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.565902 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" event={"ID":"0412910f-f78e-408c-b89b-3ed0e8d7d517","Type":"ContainerStarted","Data":"ca5ea3e71752bee64999e8e3689cd928796e46e3a882d9666a245e6e3f3c0d0b"} Jul 20 15:50:26.567504 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.567477 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9td84" event={"ID":"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d","Type":"ContainerStarted","Data":"7fa15d8c64d017949881118a0b615039985343faa2f97ca092c6f21e71387ba4"} Jul 20 15:50:26.568585 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.568561 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerStarted","Data":"2620622bc0ef7ee433f83fd6192a7e7eef2006a25019ee3593532b015daa6179"} Jul 20 15:50:26.569658 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.569631 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jzks9" event={"ID":"f6897515-482b-4c90-8bba-76d8533280be","Type":"ContainerStarted","Data":"56319b89e3eb7298b993dca697fc64a54a36044e10a6902fb224351e9c1e77ac"} Jul 20 15:50:26.570634 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.570608 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z99gh" event={"ID":"ef623006-45c5-48e1-a7bf-463fc77a82ed","Type":"ContainerStarted","Data":"4dac1767002802dc4db5ebe049bcb18e5dfc7525f1c8abdadb6a0099982cdafb"} Jul 20 15:50:26.571612 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.571590 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btmvz" event={"ID":"f51da579-40b6-4cec-8c25-cfa7c6dafc91","Type":"ContainerStarted","Data":"0f49546c8c073b39ff8c6382b4d3f61357920a5a824bb60d159198e7d8922894"} Jul 20 15:50:26.572610 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.572590 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"c6fee635efb17463ed1905a7b492dafb3e7e7c158c8632505d3dde256642a19e"} Jul 20 15:50:26.573609 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:26.573586 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t962q" event={"ID":"dc7432ba-73e0-423e-8a56-d331efb1316e","Type":"ContainerStarted","Data":"8afa7efb075a6bc9a3a80331b38701283b92ce1335b707e15465610c5d4b3b48"} Jul 20 15:50:27.065709 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.065614 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:27.065935 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.065734 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:27.065935 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.065899 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:27.066055 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.065968 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:29.065946774 +0000 UTC m=+6.012402414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:27.066470 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.066447 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:27.066595 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.066513 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:29.06649509 +0000 UTC m=+6.012950733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:27.166468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.166403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:27.166663 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.166593 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:27.166663 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.166615 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:27.166663 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.166628 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:27.166826 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.166694 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:29.166674169 +0000 UTC m=+6.113129811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:27.200872 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.200838 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:27.241945 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.241901 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 15:50:27.475987 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.475915 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:45:26 +0000 UTC" deadline="2028-03-15 22:37:35.34067949 +0000 UTC" Jul 20 15:50:27.475987 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.475984 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14502h47m7.864699815s" Jul 20 15:50:27.536188 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.535411 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:27.536188 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.535558 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:27.536188 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:27.536028 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:27.536188 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:27.536136 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:28.535104 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:28.534844 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:28.535339 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:28.535311 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:28.596754 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:28.595939 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"31783b4ed77dfc64030a66f386750024","Type":"ContainerStarted","Data":"387607116bace5fbe813ebd53462abb900ea0d37c456d26419e13fa78594048e"} Jul 20 15:50:28.602043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:28.602011 2585 generic.go:356] "Generic (PLEG): container finished" podID="0c6d814b9e1fe3f97302765f12ed4851" containerID="e99066644b5f0c2b9dec340962ce87c480d32d8c2154049e7538ed316ff1a763" exitCode=0 Jul 20 15:50:28.602181 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:28.602063 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerDied","Data":"e99066644b5f0c2b9dec340962ce87c480d32d8c2154049e7538ed316ff1a763"} Jul 20 15:50:28.654982 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:28.654043 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" podStartSLOduration=3.654020096 podStartE2EDuration="3.654020096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:28.627488781 +0000 UTC m=+5.573944439" watchObservedRunningTime="2026-07-20 15:50:28.654020096 +0000 UTC m=+5.600475757" Jul 20 15:50:29.088714 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.088620 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:29.088714 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.088687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:29.088947 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.088763 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:29.088947 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.088824 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:29.088947 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.088843 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:33.088821888 +0000 UTC m=+10.035277537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:29.088947 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.088884 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:33.088865355 +0000 UTC m=+10.035321003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:29.190003 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.189961 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:29.190179 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.190138 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:29.190179 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.190159 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:29.190179 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.190172 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:29.190373 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.190256 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:33.190234671 +0000 UTC m=+10.136690328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:29.534353 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.534264 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:29.534494 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.534424 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:29.537921 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.537893 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:29.538057 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:29.538021 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:29.611889 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:29.611852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerStarted","Data":"40c0b527d2deec5c5e86665d363c76d674c9bfb14fd3955e4a6dae6502e51b86"} Jul 20 15:50:30.535086 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:30.535048 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:30.535289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:30.535226 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:31.535097 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:31.535044 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:31.535602 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:31.535210 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:31.535602 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:31.535519 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:31.535736 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:31.535643 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:32.535864 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:32.535268 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:32.535864 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:32.535426 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:33.127116 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:33.127078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:33.127333 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:33.127139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:33.127333 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.127301 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:33.127450 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.127369 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:41.127349427 +0000 UTC m=+18.073805064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:33.127795 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.127768 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:33.127870 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.127819 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:41.127801713 +0000 UTC m=+18.074257349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:33.228004 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:33.227965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:33.228197 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.228156 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:33.228277 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.228207 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:33.228277 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.228223 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:33.228355 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.228298 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:41.228275705 +0000 UTC m=+18.174731343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:33.538408 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:33.538326 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:33.538854 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:33.538330 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:33.538854 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.538444 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:33.538854 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:33.538533 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:34.535090 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:34.535028 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:34.535316 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:34.535179 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:35.535362 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:35.535326 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:35.535859 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:35.535470 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:35.535936 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:35.535893 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:35.536016 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:35.535995 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:36.535227 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:36.535147 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:36.535415 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:36.535367 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:37.534808 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:37.534773 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:37.534962 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:37.534914 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:37.535011 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:37.534958 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:37.535062 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:37.535045 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:38.534441 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:38.534406 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:38.534906 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:38.534538 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:39.534773 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:39.534740 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:39.535261 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:39.534876 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:39.535261 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:39.534928 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:39.535261 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:39.535021 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:40.534594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:40.534567 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:40.534799 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:40.534683 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:41.188565 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:41.188526 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:41.188733 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:41.188576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:41.188733 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.188694 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:41.188733 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.188702 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:41.188862 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.188760 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:57.188739255 +0000 UTC m=+34.135194891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:41.188862 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.188781 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:57.188771212 +0000 UTC m=+34.135226851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:41.289379 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:41.289347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:41.289522 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.289506 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:41.289560 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.289526 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:41.289560 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.289535 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:41.289622 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.289604 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:50:57.289572075 +0000 UTC m=+34.236027708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:41.534978 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:41.534889 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:41.535426 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.535026 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:41.535426 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:41.535084 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:41.535426 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:41.535203 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:42.534733 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:42.534702 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:42.534921 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:42.534822 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:43.535696 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:43.535662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:43.536274 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:43.535743 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:43.536382 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:43.536331 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:43.536448 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:43.536374 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:44.534782 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:44.534745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:44.534967 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:44.534897 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:45.535196 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:45.535142 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:45.535623 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:45.535290 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:45.535623 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:45.535353 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:45.535623 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:45.535452 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:46.535287 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.534945 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:46.535871 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:46.535419 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:46.647453 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.647420 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" event={"ID":"0412910f-f78e-408c-b89b-3ed0e8d7d517","Type":"ContainerStarted","Data":"91bcabf5610e4d4f24f2b83cb246865c762b51df478a37810e69197cebbdfd3c"} Jul 20 15:50:46.648762 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.648730 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9td84" event={"ID":"d6cfd7db-a1f8-4cd7-b99b-fca34c24987d","Type":"ContainerStarted","Data":"59a46d96e30fbcb23285e96c912318db182a0ce05aab32f10d02fc83f118a349"} Jul 20 15:50:46.650217 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.650176 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="388626e6871b36a643a33081136cf1629a52300be007588fafdaf4ae9f434028" exitCode=0 Jul 20 15:50:46.650311 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.650249 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"388626e6871b36a643a33081136cf1629a52300be007588fafdaf4ae9f434028"} Jul 20 15:50:46.651624 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.651536 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jzks9" event={"ID":"f6897515-482b-4c90-8bba-76d8533280be","Type":"ContainerStarted","Data":"b88d111e01833a0d7e9c20990f0aab374127684de9793ab0a3da91ceafa537f3"} Jul 20 15:50:46.652925 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.652847 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z99gh" event={"ID":"ef623006-45c5-48e1-a7bf-463fc77a82ed","Type":"ContainerStarted","Data":"0b08129fd311b979078fa638c8986f99f74670efcadb6dffb1f03c16d4256303"} Jul 20 15:50:46.654388 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.654365 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-btmvz" event={"ID":"f51da579-40b6-4cec-8c25-cfa7c6dafc91","Type":"ContainerStarted","Data":"0dc7fcbdc0aa259a405024427f09297b344c1925b30580e25b3b3ab1f75b9186"} Jul 20 15:50:46.657223 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657206 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:50:46.657566 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657546 2585 generic.go:356] "Generic (PLEG): container finished" podID="dad3ef21-b04e-4226-a03c-a151dd3fd47c" containerID="921a722c3f897776bff8a84b4f822422a4de131cf48c346329eb90ee81059736" exitCode=1 Jul 20 15:50:46.657639 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657615 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"c566ed73492ee3675314fef77ffe6de16e5f2a157b6c56956e1d10aa9fa4a7bb"} Jul 20 15:50:46.657704 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657674 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"133ff469c4f8781032285718f38b3d468a4949faa0659d615d6e88fec874b89b"} Jul 20 15:50:46.657755 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"32bd0444eaa73e1bef358fffe96cda495cbb3c387a4036acba5272bc567b62c7"} Jul 20 15:50:46.657832 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657755 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"d6c4b4face1704a1c2161fbdc5859a59240bb565c016bc22549f5a1774bad959"} Jul 20 15:50:46.657832 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerDied","Data":"921a722c3f897776bff8a84b4f822422a4de131cf48c346329eb90ee81059736"} Jul 20 15:50:46.657938 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.657834 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"c2ad996a5668ce6e43cdec76da9c22a633d74c0422fb6518168b6acce648a92a"} Jul 20 15:50:46.659077 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.659049 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t962q" event={"ID":"dc7432ba-73e0-423e-8a56-d331efb1316e","Type":"ContainerStarted","Data":"5e34e766d5c3ec46ef676de5a5a400d0894fa4f4b3d561326110ee0e792f951e"} Jul 20 15:50:46.672038 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.671988 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" podStartSLOduration=21.671973111 podStartE2EDuration="21.671973111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:29.631678162 +0000 UTC m=+6.578133822" watchObservedRunningTime="2026-07-20 15:50:46.671973111 +0000 UTC m=+23.618428765" Jul 20 15:50:46.713043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.712978 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-btmvz" podStartSLOduration=7.247247771 podStartE2EDuration="22.712957077s" totalImagesPullingTime="15.465709306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:46.710866786 +0000 UTC m=+23.657322440" watchObservedRunningTime="2026-07-20 15:50:46.712957077 +0000 UTC m=+23.659412735" Jul 20 15:50:46.713317 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.713280 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9td84" podStartSLOduration=2.660400691 podStartE2EDuration="22.713268284s" totalImagesPullingTime="20.052867593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:46.672414778 +0000 UTC m=+23.618870434" watchObservedRunningTime="2026-07-20 15:50:46.713268284 +0000 UTC m=+23.659723941" Jul 20 15:50:46.739251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.739201 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z99gh" podStartSLOduration=2.621890803 podStartE2EDuration="22.739187306s" totalImagesPullingTime="20.117296503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:46.738904941 +0000 UTC m=+23.685360597" watchObservedRunningTime="2026-07-20 15:50:46.739187306 +0000 UTC m=+23.685642961" Jul 20 15:50:46.761302 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.761243 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t962q" podStartSLOduration=2.639091604 podStartE2EDuration="22.761226551s" totalImagesPullingTime="20.122134947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:46.760777027 +0000 UTC m=+23.707232683" watchObservedRunningTime="2026-07-20 15:50:46.761226551 +0000 UTC m=+23.707682205" Jul 20 15:50:46.809850 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:46.809791 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jzks9" podStartSLOduration=2.714854387 podStartE2EDuration="22.809766938s" totalImagesPullingTime="20.094912551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:46.78112393 +0000 UTC m=+23.727579584" watchObservedRunningTime="2026-07-20 15:50:46.809766938 +0000 UTC m=+23.756222594" Jul 20 15:50:47.534370 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.534344 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:47.534559 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:47.534444 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:47.534559 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.534492 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:47.534670 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:47.534575 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:47.577810 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.577781 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 15:50:47.663499 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.663464 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv6kt" event={"ID":"a466a462-4e6b-4d37-b69e-c6b2e7fc92da","Type":"ContainerStarted","Data":"018851606a08025b88fb344424dc94472db2d7e66859032087db105acd8f2ea2"} Jul 20 15:50:47.665560 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.665529 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" event={"ID":"0412910f-f78e-408c-b89b-3ed0e8d7d517","Type":"ContainerStarted","Data":"108fc73786d557b97c1783f58680f52bc54d7f8d296ae490dc397897f7f7a084"} Jul 20 15:50:47.679344 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:47.679298 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qv6kt" podStartSLOduration=3.02052678 podStartE2EDuration="22.679282826s" totalImagesPullingTime="19.658756046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:47.678942892 +0000 UTC m=+24.625398546" watchObservedRunningTime="2026-07-20 15:50:47.679282826 +0000 UTC m=+24.625738481" Jul 20 15:50:48.524649 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:48.524535 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T15:50:47.57780141Z","UUID":"782e2551-59ef-4dce-bb01-1eb0acd9c822","Handler":null,"Name":"","Endpoint":""} Jul 20 15:50:48.526271 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:48.526245 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 15:50:48.526399 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:48.526287 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 15:50:48.534228 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:48.534202 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:48.534372 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:48.534309 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:49.534716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.534481 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:49.534716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:49.534636 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:49.534716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.534686 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:49.535346 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:49.534773 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:49.671902 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.671859 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" event={"ID":"0412910f-f78e-408c-b89b-3ed0e8d7d517","Type":"ContainerStarted","Data":"683515b113b4d2be97f69d5295c62e1b6aad872b0b8f070d2532584fc146d7c0"} Jul 20 15:50:49.674577 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.674555 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:50:49.674896 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.674876 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"2ae9562629ef1d65d4503af9907a9ab36f1e94789cbac504753ad46987636400"} Jul 20 15:50:49.695891 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.695840 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6td4" podStartSLOduration=2.727489524 podStartE2EDuration="25.695822894s" totalImagesPullingTime="22.96833337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:49.695671511 +0000 UTC m=+26.642127162" watchObservedRunningTime="2026-07-20 15:50:49.695822894 +0000 UTC m=+26.642278548" Jul 20 15:50:49.808183 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.808077 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:49.808703 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:49.808681 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:50.534687 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:50.534500 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:50.534866 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:50.534786 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:50.677685 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:50.677657 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:50.678186 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:50.678151 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-btmvz" Jul 20 15:50:51.534577 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:51.534543 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:51.534577 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:51.534561 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:51.534811 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:51.534687 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:51.534861 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:51.534823 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:52.535289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.535111 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:52.535926 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:52.535375 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:52.683641 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.683606 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="b3c528733a4e35bf75a568f37ea7eeea07abe3479c5481232387d27b8f65633d" exitCode=0 Jul 20 15:50:52.683829 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.683692 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"b3c528733a4e35bf75a568f37ea7eeea07abe3479c5481232387d27b8f65633d"} Jul 20 15:50:52.690284 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.690265 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:50:52.690671 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.690643 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"50e52d9389f307b73a522e1fa1a4ba72f8922a31487ace851a30912f96932002"} Jul 20 15:50:52.691140 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:52.691120 2585 scope.go:117] "RemoveContainer" containerID="921a722c3f897776bff8a84b4f822422a4de131cf48c346329eb90ee81059736" Jul 20 15:50:53.535047 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.535014 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:53.535299 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:53.535117 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:53.535299 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.535178 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:53.535299 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:53.535273 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:53.696646 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.696621 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:50:53.696971 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.696944 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" event={"ID":"dad3ef21-b04e-4226-a03c-a151dd3fd47c","Type":"ContainerStarted","Data":"1be00e6095c0694d7d2a40c9ca66795eb2446f99ef5146e64d0f7f89d7644700"} Jul 20 15:50:53.697144 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.697119 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:53.697281 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.697190 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:53.697281 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.697233 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:53.712796 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.712769 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:53.712935 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.712867 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:50:53.729253 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:53.729209 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" podStartSLOduration=9.559903048 podStartE2EDuration="29.72919475s" totalImagesPullingTime="20.169291702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:50:53.726334922 +0000 UTC m=+30.672790577" watchObservedRunningTime="2026-07-20 15:50:53.72919475 +0000 UTC m=+30.675650404" Jul 20 15:50:54.040985 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.040894 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zkqjw"] Jul 20 15:50:54.041144 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.041040 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:54.041144 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:54.041131 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:54.043477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.043443 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqlgj"] Jul 20 15:50:54.043595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.043560 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:54.043687 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:54.043669 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:54.057906 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.057877 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nfmm"] Jul 20 15:50:54.058036 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.057990 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:54.058084 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:54.058068 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:54.701907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.701876 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="0e5a2e04b98e58f4e2167ef541643ae127610dd6e041132da6714d7bf8af14f7" exitCode=0 Jul 20 15:50:54.702359 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:54.701966 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"0e5a2e04b98e58f4e2167ef541643ae127610dd6e041132da6714d7bf8af14f7"} Jul 20 15:50:55.534913 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:55.534883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:55.535125 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:55.534883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:55.535125 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:55.535009 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:55.535125 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:55.535026 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:55.535306 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:55.535123 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:55.535306 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:55.535241 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:56.708078 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:56.708045 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="d53b511b4b3581876c0e8638696a7afa6f63b377676697fb8fee629733682d4a" exitCode=0 Jul 20 15:50:56.708475 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:56.708104 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"d53b511b4b3581876c0e8638696a7afa6f63b377676697fb8fee629733682d4a"} Jul 20 15:50:57.203378 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.203342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:57.203571 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.203390 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:57.203571 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.203495 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:57.203571 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.203508 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:57.203571 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.203557 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs podName:6ce0d48b-a392-4737-9690-a5f8f3ff3c83 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:29.203541057 +0000 UTC m=+66.149996690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs") pod "network-metrics-daemon-zkqjw" (UID: "6ce0d48b-a392-4737-9690-a5f8f3ff3c83") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 15:50:57.203571 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.203572 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret podName:bb63bde8-6d03-403d-8886-7b806aa6ca33 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:29.203565654 +0000 UTC m=+66.150021286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret") pod "global-pull-secret-syncer-6nfmm" (UID: "bb63bde8-6d03-403d-8886-7b806aa6ca33") : object "kube-system"/"original-pull-secret" not registered Jul 20 15:50:57.304354 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.304322 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:57.304510 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.304466 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 15:50:57.304510 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.304484 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 15:50:57.304510 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.304493 2585 projected.go:196] Error preparing data for projected volume kube-api-access-mbvkk for pod openshift-network-diagnostics/network-check-target-vqlgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:57.304653 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.304555 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk podName:ad2979fa-0c82-4749-98a7-10b1cdd27058 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:29.304537698 +0000 UTC m=+66.250993351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mbvkk" (UniqueName: "kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk") pod "network-check-target-vqlgj" (UID: "ad2979fa-0c82-4749-98a7-10b1cdd27058") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 15:50:57.534827 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.534793 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:57.534974 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.534844 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:57.534974 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:57.534802 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:57.534974 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.534924 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:57.535137 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.535079 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:57.535212 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:57.535175 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:59.534899 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.534788 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:50:59.534899 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.534818 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:50:59.535525 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:59.534928 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vqlgj" podUID="ad2979fa-0c82-4749-98a7-10b1cdd27058" Jul 20 15:50:59.535525 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:59.535000 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nfmm" podUID="bb63bde8-6d03-403d-8886-7b806aa6ca33" Jul 20 15:50:59.535525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.535019 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:50:59.535525 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:59.535122 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zkqjw" podUID="6ce0d48b-a392-4737-9690-a5f8f3ff3c83" Jul 20 15:50:59.828219 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.828189 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeReady" Jul 20 15:50:59.828397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.828348 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 15:50:59.871351 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.871315 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:50:59.873591 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.873571 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:50:59.876392 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.876361 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf"] Jul 20 15:50:59.877026 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.877006 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 15:50:59.878035 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.878009 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:50:59.879503 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.879485 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 15:50:59.879907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.879750 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 15:50:59.879907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.879750 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-js84c\"" Jul 20 15:50:59.882201 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:50:59.881634 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-gxkdd\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gxkdd\"" type="*v1.Secret" Jul 20 15:50:59.882201 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.882122 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk"] Jul 20 15:50:59.884068 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.884049 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22"] Jul 20 15:50:59.884274 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.884248 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:50:59.885824 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.885804 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zwcjg"] Jul 20 15:50:59.885948 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.885932 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" Jul 20 15:50:59.886507 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.886481 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 15:50:59.887442 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.887392 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.887590 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.887573 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59bf898cc6-pfftd"] Jul 20 15:50:59.887759 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.887726 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:50:59.888418 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.888401 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 20 15:50:59.889241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.889223 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5"] Jul 20 15:50:59.889373 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.889344 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:50:59.891224 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891132 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 20 15:50:59.891318 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891228 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.891702 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891685 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 20 15:50:59.891808 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891737 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5"] Jul 20 15:50:59.891919 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891901 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.891919 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.891916 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pz9ww\"" Jul 20 15:50:59.892063 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892052 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g27sj\"" Jul 20 15:50:59.892136 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892071 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892204 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892208 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892312 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892511 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892539 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892582 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.892876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892813 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 20 15:50:59.893266 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.892957 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.893266 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893005 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 15:50:59.893266 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893144 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 15:50:59.893266 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893225 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gf5vm\"" Jul 20 15:50:59.893433 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893409 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mkslq\"" Jul 20 15:50:59.893433 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893428 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 15:50:59.893628 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893577 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.893866 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.893808 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j"] Jul 20 15:50:59.894179 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.894081 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 20 15:50:59.894636 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.894147 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:50:59.894636 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.894171 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 15:50:59.905494 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.904070 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-822pj"] Jul 20 15:50:59.905494 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.904388 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:50:59.909211 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909184 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 20 15:50:59.909211 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909206 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h5v5w\"" Jul 20 15:50:59.909399 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909369 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.909399 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909395 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b44jg\"" Jul 20 15:50:59.909589 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909572 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.909649 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909588 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.909974 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909953 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9g9lm\"" Jul 20 15:50:59.910049 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.909983 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.910244 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.910227 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 15:50:59.910962 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.910932 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 20 15:50:59.911235 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911214 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:50:59.911331 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911282 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf"] Jul 20 15:50:59.911331 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911306 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22"] Jul 20 15:50:59.911545 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911202 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.911545 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911446 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:50:59.911545 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911469 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 15:50:59.911695 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.911633 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.912091 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.912068 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk"] Jul 20 15:50:59.913418 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.913391 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zwcjg"] Jul 20 15:50:59.913865 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.913848 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.914048 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.914020 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j"] Jul 20 15:50:59.914462 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.914433 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.914713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.914697 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 15:50:59.914872 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.914856 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-822pj"] Jul 20 15:50:59.915047 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.915032 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kxbfq\"" Jul 20 15:50:59.915126 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.915039 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 15:50:59.915739 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.915720 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59bf898cc6-pfftd"] Jul 20 15:50:59.918621 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.918600 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5"] Jul 20 15:50:59.918766 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.918754 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5"] Jul 20 15:50:59.921053 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.921034 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ldhw9"] Jul 20 15:50:59.923725 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.923709 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gx2pp"] Jul 20 15:50:59.924071 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.923965 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 15:50:59.924371 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.923973 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldhw9" Jul 20 15:50:59.927024 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.927003 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:50:59.927141 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.927122 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 15:50:59.927360 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.927344 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5lhc8\"" Jul 20 15:50:59.927596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.927581 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 15:50:59.932453 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.932426 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z5q65\"" Jul 20 15:50:59.932863 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.932845 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 15:50:59.932968 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.932871 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 15:50:59.932968 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.932938 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 15:50:59.936221 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.935378 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx2pp"] Jul 20 15:50:59.936343 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:50:59.936266 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldhw9"] Jul 20 15:51:00.024393 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024348 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6nl5\" (UniqueName: \"kubernetes.io/projected/204bc367-6913-4cfd-aec5-52555cba01b4-kube-api-access-b6nl5\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.024562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024413 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d0a46-8688-4312-9717-debba413e3c4-tmp-dir\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.024562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024486 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5870db0-8958-4913-8a6f-e5e696ab35bf-cert\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.024562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.024720 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024556 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psd4s\" (UniqueName: \"kubernetes.io/projected/61a9f7b8-1af0-4c94-85c1-e54ca0d9081b-kube-api-access-psd4s\") pod \"volume-data-source-validator-78cf4c6f6-x2r22\" (UID: \"61a9f7b8-1af0-4c94-85c1-e54ca0d9081b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" Jul 20 15:51:00.024720 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024606 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.024720 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024637 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/e24fa95d-233e-489d-8afa-ef901fdcbbf9-kube-api-access-hn2jc\") pod \"network-check-source-7bc5b6bf85-5bmb5\" (UID: \"e24fa95d-233e-489d-8afa-ef901fdcbbf9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" Jul 20 15:51:00.024720 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kjl\" (UniqueName: \"kubernetes.io/projected/e5870db0-8958-4913-8a6f-e5e696ab35bf-kube-api-access-d7kjl\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.024939 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024725 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204bc367-6913-4cfd-aec5-52555cba01b4-serving-cert\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.024939 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-stats-auth\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.024939 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.024795 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.025128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.025286 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.025286 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025271 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.025400 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025315 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4rv\" (UniqueName: \"kubernetes.io/projected/d7ab0453-cd1e-4355-b302-b20b40bead04-kube-api-access-5g4rv\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.025400 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025371 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-snapshots\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.025495 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025425 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6e20df-8416-4f82-84f0-2f78f572dc43-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.025495 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025462 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-default-certificate\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.025596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.025684 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025613 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqlnh\" (UniqueName: \"kubernetes.io/projected/9d4d0a46-8688-4312-9717-debba413e3c4-kube-api-access-fqlnh\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.025788 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025737 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttz2\" (UniqueName: \"kubernetes.io/projected/b91d4e70-7530-4d0d-bb98-975cff1b2e25-kube-api-access-jttz2\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.025854 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025789 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-tmp\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.025906 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-service-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.025906 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025899 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.025997 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025933 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4d0a46-8688-4312-9717-debba413e3c4-config-volume\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.025997 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.025984 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.026074 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026012 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-trusted-ca\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.026123 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c10ad4-9606-4730-ab5d-8e0915396b71-config\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.026191 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026137 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9l2b\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.026251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec6e20df-8416-4f82-84f0-2f78f572dc43-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.026251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.026352 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026256 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvzmz\" (UniqueName: \"kubernetes.io/projected/f6c10ad4-9606-4730-ab5d-8e0915396b71-kube-api-access-gvzmz\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.026491 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026464 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.026548 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026519 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c10ad4-9606-4730-ab5d-8e0915396b71-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.026688 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026659 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n7s\" (UniqueName: \"kubernetes.io/projected/bd21cd47-381b-46af-993e-d5a24caba364-kube-api-access-24n7s\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.026761 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026719 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.026813 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026785 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-config\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.026865 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026847 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd21cd47-381b-46af-993e-d5a24caba364-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.026910 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.026992 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.026976 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4904ff-edd9-474d-abb9-08b494454108-serving-cert\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.027053 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.027016 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghgz\" (UniqueName: \"kubernetes.io/projected/9e4904ff-edd9-474d-abb9-08b494454108-kube-api-access-8ghgz\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.027106 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.027074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cszb\" (UniqueName: \"kubernetes.io/projected/ec6e20df-8416-4f82-84f0-2f78f572dc43-kube-api-access-8cszb\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.089985 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.089873 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-btmvz_f51da579-40b6-4cec-8c25-cfa7c6dafc91/konnectivity-agent/0.log" limit=1024 Jul 20 15:51:00.128222 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128184 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttz2\" (UniqueName: \"kubernetes.io/projected/b91d4e70-7530-4d0d-bb98-975cff1b2e25-kube-api-access-jttz2\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.128222 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128225 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-tmp\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128250 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-service-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128300 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4d0a46-8688-4312-9717-debba413e3c4-config-volume\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128360 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-trusted-ca\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.128477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c10ad4-9606-4730-ab5d-8e0915396b71-config\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.128792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128451 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9l2b\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.128792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128513 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec6e20df-8416-4f82-84f0-2f78f572dc43-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.128792 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.128529 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:00.128792 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.128610 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.628589068 +0000 UTC m=+37.575044701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:00.128792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128656 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-tmp\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.129039 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128921 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-service-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129035 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4d0a46-8688-4312-9717-debba413e3c4-config-volume\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.128539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129088 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c10ad4-9606-4730-ab5d-8e0915396b71-config\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvzmz\" (UniqueName: \"kubernetes.io/projected/f6c10ad4-9606-4730-ab5d-8e0915396b71-kube-api-access-gvzmz\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c10ad4-9606-4730-ab5d-8e0915396b71-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24n7s\" (UniqueName: \"kubernetes.io/projected/bd21cd47-381b-46af-993e-d5a24caba364-kube-api-access-24n7s\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129252 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129279 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-config\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129303 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd21cd47-381b-46af-993e-d5a24caba364-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4904ff-edd9-474d-abb9-08b494454108-serving-cert\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghgz\" (UniqueName: \"kubernetes.io/projected/9e4904ff-edd9-474d-abb9-08b494454108-kube-api-access-8ghgz\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cszb\" (UniqueName: \"kubernetes.io/projected/ec6e20df-8416-4f82-84f0-2f78f572dc43-kube-api-access-8cszb\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6nl5\" (UniqueName: \"kubernetes.io/projected/204bc367-6913-4cfd-aec5-52555cba01b4-kube-api-access-b6nl5\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.129486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129479 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4904ff-edd9-474d-abb9-08b494454108-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129488 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d0a46-8688-4312-9717-debba413e3c4-tmp-dir\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.129492 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129512 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5870db0-8958-4913-8a6f-e5e696ab35bf-cert\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129541 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.129570 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.629549118 +0000 UTC m=+37.576004753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.129621 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129620 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psd4s\" (UniqueName: \"kubernetes.io/projected/61a9f7b8-1af0-4c94-85c1-e54ca0d9081b-kube-api-access-psd4s\") pod \"volume-data-source-validator-78cf4c6f6-x2r22\" (UID: \"61a9f7b8-1af0-4c94-85c1-e54ca0d9081b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.129675 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.629659959 +0000 UTC m=+37.576115607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129704 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/e24fa95d-233e-489d-8afa-ef901fdcbbf9-kube-api-access-hn2jc\") pod \"network-check-source-7bc5b6bf85-5bmb5\" (UID: \"e24fa95d-233e-489d-8afa-ef901fdcbbf9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129748 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kjl\" (UniqueName: \"kubernetes.io/projected/e5870db0-8958-4913-8a6f-e5e696ab35bf-kube-api-access-d7kjl\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129772 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204bc367-6913-4cfd-aec5-52555cba01b4-serving-cert\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129795 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-stats-auth\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129808 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-trusted-ca\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129823 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129851 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129880 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129918 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4rv\" (UniqueName: \"kubernetes.io/projected/d7ab0453-cd1e-4355-b302-b20b40bead04-kube-api-access-5g4rv\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129973 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-snapshots\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.129999 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6e20df-8416-4f82-84f0-2f78f572dc43-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130023 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-default-certificate\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130077 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd21cd47-381b-46af-993e-d5a24caba364-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqlnh\" (UniqueName: \"kubernetes.io/projected/9d4d0a46-8688-4312-9717-debba413e3c4-kube-api-access-fqlnh\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.130246 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.130260 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.130310 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.630296618 +0000 UTC m=+37.576752259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130768 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.130817 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.130781 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.630767777 +0000 UTC m=+37.577223433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:00.131527 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.130813 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d0a46-8688-4312-9717-debba413e3c4-tmp-dir\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.131527 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.131005 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204bc367-6913-4cfd-aec5-52555cba01b4-config\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.131527 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.131382 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e4904ff-edd9-474d-abb9-08b494454108-snapshots\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.131527 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.131475 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:00.131527 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.131518 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:00.631502865 +0000 UTC m=+37.577958513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:00.132220 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.132194 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ec6e20df-8416-4f82-84f0-2f78f572dc43-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.135291 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.135228 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c10ad4-9606-4730-ab5d-8e0915396b71-serving-cert\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.135473 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.135448 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-default-certificate\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.135559 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.135519 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.135768 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.135746 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4904ff-edd9-474d-abb9-08b494454108-serving-cert\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.135877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.135793 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204bc367-6913-4cfd-aec5-52555cba01b4-serving-cert\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.136456 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.136412 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec6e20df-8416-4f82-84f0-2f78f572dc43-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.136560 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.136496 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-stats-auth\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.136793 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.136771 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5870db0-8958-4913-8a6f-e5e696ab35bf-cert\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.137546 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.137525 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.142042 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.142010 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvzmz\" (UniqueName: \"kubernetes.io/projected/f6c10ad4-9606-4730-ab5d-8e0915396b71-kube-api-access-gvzmz\") pod \"service-ca-operator-5bcbc94c78-lqfmf\" (UID: \"f6c10ad4-9606-4730-ab5d-8e0915396b71\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:00.142141 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.142117 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9l2b\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.142533 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.142512 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttz2\" (UniqueName: \"kubernetes.io/projected/b91d4e70-7530-4d0d-bb98-975cff1b2e25-kube-api-access-jttz2\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.143016 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.142993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.145439 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.145289 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4rv\" (UniqueName: \"kubernetes.io/projected/d7ab0453-cd1e-4355-b302-b20b40bead04-kube-api-access-5g4rv\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.147270 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.147234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psd4s\" (UniqueName: \"kubernetes.io/projected/61a9f7b8-1af0-4c94-85c1-e54ca0d9081b-kube-api-access-psd4s\") pod \"volume-data-source-validator-78cf4c6f6-x2r22\" (UID: \"61a9f7b8-1af0-4c94-85c1-e54ca0d9081b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" Jul 20 15:51:00.147500 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.147476 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghgz\" (UniqueName: \"kubernetes.io/projected/9e4904ff-edd9-474d-abb9-08b494454108-kube-api-access-8ghgz\") pod \"insights-operator-555d9d7885-zwcjg\" (UID: \"9e4904ff-edd9-474d-abb9-08b494454108\") " pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.147905 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.147858 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kjl\" (UniqueName: \"kubernetes.io/projected/e5870db0-8958-4913-8a6f-e5e696ab35bf-kube-api-access-d7kjl\") pod \"ingress-canary-gx2pp\" (UID: \"e5870db0-8958-4913-8a6f-e5e696ab35bf\") " pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.149067 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.149029 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n7s\" (UniqueName: \"kubernetes.io/projected/bd21cd47-381b-46af-993e-d5a24caba364-kube-api-access-24n7s\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.149305 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.149279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cszb\" (UniqueName: \"kubernetes.io/projected/ec6e20df-8416-4f82-84f0-2f78f572dc43-kube-api-access-8cszb\") pod \"kube-storage-version-migrator-operator-7658d9b749-lskfk\" (UID: \"ec6e20df-8416-4f82-84f0-2f78f572dc43\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.149427 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.149404 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqlnh\" (UniqueName: \"kubernetes.io/projected/9d4d0a46-8688-4312-9717-debba413e3c4-kube-api-access-fqlnh\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.149810 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.149787 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/e24fa95d-233e-489d-8afa-ef901fdcbbf9-kube-api-access-hn2jc\") pod \"network-check-source-7bc5b6bf85-5bmb5\" (UID: \"e24fa95d-233e-489d-8afa-ef901fdcbbf9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" Jul 20 15:51:00.152380 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.152360 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6nl5\" (UniqueName: \"kubernetes.io/projected/204bc367-6913-4cfd-aec5-52555cba01b4-kube-api-access-b6nl5\") pod \"console-operator-565b7b569d-822pj\" (UID: \"204bc367-6913-4cfd-aec5-52555cba01b4\") " pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.215872 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.215839 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" Jul 20 15:51:00.225949 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.225914 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" Jul 20 15:51:00.233816 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.233791 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" Jul 20 15:51:00.251079 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.251049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" Jul 20 15:51:00.271394 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.271355 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:00.285405 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.285369 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx2pp" Jul 20 15:51:00.636128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636083 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.636128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636190 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636224 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636285 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636330 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.636306222 +0000 UTC m=+38.582761869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636340 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636358 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.636347728 +0000 UTC m=+38.582803371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.636429 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636359 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636482 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.636470711 +0000 UTC m=+38.582926349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636359 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636518 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.636509808 +0000 UTC m=+38.582965441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636368 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636532 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:00.636878 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636556 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.636546437 +0000 UTC m=+38.583002073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:00.637572 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:00.636575 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:01.63656188 +0000 UTC m=+38.583017513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:00.701261 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.701229 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gxkdd\"" Jul 20 15:51:00.710909 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:00.710871 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" Jul 20 15:51:01.486380 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.486078 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf"] Jul 20 15:51:01.497969 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:01.497924 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c10ad4_9606_4730_ab5d_8e0915396b71.slice/crio-43a82a51567a9e95c818192b737bb87e550f404bc752bdabcf58a9ebf0ceb66b WatchSource:0}: Error finding container 43a82a51567a9e95c818192b737bb87e550f404bc752bdabcf58a9ebf0ceb66b: Status 404 returned error can't find the container with id 43a82a51567a9e95c818192b737bb87e550f404bc752bdabcf58a9ebf0ceb66b Jul 20 15:51:01.513498 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.513465 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5"] Jul 20 15:51:01.531390 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.531366 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22"] Jul 20 15:51:01.534556 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.534531 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:51:01.534666 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.534531 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:51:01.534728 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.534530 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:51:01.543208 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.543190 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 15:51:01.543371 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.543313 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 15:51:01.543430 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.543313 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6j7cm\"" Jul 20 15:51:01.544310 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.544295 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7vt6p\"" Jul 20 15:51:01.549565 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.549461 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx2pp"] Jul 20 15:51:01.553422 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.553399 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-zwcjg"] Jul 20 15:51:01.554516 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.554490 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk"] Jul 20 15:51:01.563488 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.563463 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-822pj"] Jul 20 15:51:01.564064 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:01.563904 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24fa95d_233e_489d_8afa_ef901fdcbbf9.slice/crio-46fe3162aa10a76056a645cef97a0dfc16cbdfb440c9a501f7266691d0796743 WatchSource:0}: Error finding container 46fe3162aa10a76056a645cef97a0dfc16cbdfb440c9a501f7266691d0796743: Status 404 returned error can't find the container with id 46fe3162aa10a76056a645cef97a0dfc16cbdfb440c9a501f7266691d0796743 Jul 20 15:51:01.565272 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:01.565047 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204bc367_6913_4cfd_aec5_52555cba01b4.slice/crio-03483b430ffd720f28877f705f98cf2185ffdeaa7e3942c13cddc25548218346 WatchSource:0}: Error finding container 03483b430ffd720f28877f705f98cf2185ffdeaa7e3942c13cddc25548218346: Status 404 returned error can't find the container with id 03483b430ffd720f28877f705f98cf2185ffdeaa7e3942c13cddc25548218346 Jul 20 15:51:01.648124 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648085 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648134 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648265 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648283 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648336 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648322612 +0000 UTC m=+40.594778246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648286 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648387 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648385 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648424 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648414886 +0000 UTC m=+40.594870521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648441 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648448 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648439301 +0000 UTC m=+40.594894934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648476 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648463849 +0000 UTC m=+40.594919482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.648537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:01.648603 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648598 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:01.649054 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648619 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648611517 +0000 UTC m=+40.595067150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:01.649054 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:01.648640 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:03.648629034 +0000 UTC m=+40.595084668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:01.723382 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.723349 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="879f60846bc463b4be0e21e7e8398e385313776618e61ce2ad0a2e4d6039ba98" exitCode=0 Jul 20 15:51:01.723525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.723434 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"879f60846bc463b4be0e21e7e8398e385313776618e61ce2ad0a2e4d6039ba98"} Jul 20 15:51:01.724747 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.724633 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" event={"ID":"f6c10ad4-9606-4730-ab5d-8e0915396b71","Type":"ContainerStarted","Data":"43a82a51567a9e95c818192b737bb87e550f404bc752bdabcf58a9ebf0ceb66b"} Jul 20 15:51:01.725691 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.725669 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" event={"ID":"61a9f7b8-1af0-4c94-85c1-e54ca0d9081b","Type":"ContainerStarted","Data":"f3addcf812da3f031b18c1ff7edf51210d0398322cd0872cc5b49226f2b19ac0"} Jul 20 15:51:01.726844 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.726821 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx2pp" event={"ID":"e5870db0-8958-4913-8a6f-e5e696ab35bf","Type":"ContainerStarted","Data":"de9b6445603847598344e59289c66b6cbad9c4d93bf0cd18ce88d29e9bf6c14c"} Jul 20 15:51:01.728112 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.728090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" event={"ID":"ec6e20df-8416-4f82-84f0-2f78f572dc43","Type":"ContainerStarted","Data":"043362454b0d3cb53fb06c4ade1d68d777d7cdbae62af44fa645f7b54c0482ee"} Jul 20 15:51:01.729201 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.729182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" event={"ID":"e24fa95d-233e-489d-8afa-ef901fdcbbf9","Type":"ContainerStarted","Data":"46fe3162aa10a76056a645cef97a0dfc16cbdfb440c9a501f7266691d0796743"} Jul 20 15:51:01.730224 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.730180 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-822pj" event={"ID":"204bc367-6913-4cfd-aec5-52555cba01b4","Type":"ContainerStarted","Data":"03483b430ffd720f28877f705f98cf2185ffdeaa7e3942c13cddc25548218346"} Jul 20 15:51:01.731390 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:01.731358 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" event={"ID":"9e4904ff-edd9-474d-abb9-08b494454108","Type":"ContainerStarted","Data":"bd8219b66396f9de9668413ed08edc6f2d0ac10132b9fce0d10597c0fb85c2b5"} Jul 20 15:51:02.749836 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:02.748764 2585 generic.go:356] "Generic (PLEG): container finished" podID="1f0ffbaa-9934-4bd0-9369-f747f9d2ab71" containerID="7622e97ce07b2dcec4564093c95537538e57ebd16cdfc07c8bbbaf2523c34e94" exitCode=0 Jul 20 15:51:02.749836 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:02.748844 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerDied","Data":"7622e97ce07b2dcec4564093c95537538e57ebd16cdfc07c8bbbaf2523c34e94"} Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669420 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669461 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.669602 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.669754 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.669814 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.669796096 +0000 UTC m=+44.616251738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670272 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670329 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.670311277 +0000 UTC m=+44.616766913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670398 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.670385266 +0000 UTC m=+44.616840921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670460 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670488 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.670478124 +0000 UTC m=+44.616933761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670551 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:03.670716 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670562 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:03.671809 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670592 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.670581337 +0000 UTC m=+44.617036973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:03.671809 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670648 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:03.671809 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:03.670680 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:07.670670057 +0000 UTC m=+44.617125695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:03.754842 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.754752 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" event={"ID":"61a9f7b8-1af0-4c94-85c1-e54ca0d9081b","Type":"ContainerStarted","Data":"4324c4ebd1a2d67be3efd3f6f47fbff166690cb3227c08a14a7fab060e420e4b"} Jul 20 15:51:03.761277 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.760663 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7z48" event={"ID":"1f0ffbaa-9934-4bd0-9369-f747f9d2ab71","Type":"ContainerStarted","Data":"0b47f7d2db0a7b0d87b88349d083c6f1c67f0e7addc33048549f282ebcecd51e"} Jul 20 15:51:03.775563 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.775277 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-x2r22" podStartSLOduration=14.928073583 podStartE2EDuration="16.775255117s" totalImagesPullingTime="1.847181534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:03.774865614 +0000 UTC m=+40.721321270" watchObservedRunningTime="2026-07-20 15:51:03.775255117 +0000 UTC m=+40.721710773" Jul 20 15:51:03.801665 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:03.801605 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z7z48" podStartSLOduration=7.748298136 podStartE2EDuration="39.801586448s" totalImagesPullingTime="32.053288312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:03.80091573 +0000 UTC m=+40.747371397" watchObservedRunningTime="2026-07-20 15:51:03.801586448 +0000 UTC m=+40.748042104" Jul 20 15:51:07.701676 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701640 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:07.701676 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701726 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701756 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701791 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701794 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701818 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701868 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.701851615 +0000 UTC m=+52.648307248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701868 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701896 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.701879992 +0000 UTC m=+52.648335625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701887 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:07.701921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701931 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.701919589 +0000 UTC m=+52.648375226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701873 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701970 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.701959162 +0000 UTC m=+52.648414796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.701983 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:07.702127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.702003 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.701987437 +0000 UTC m=+52.648443084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:07.702586 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:07.702021 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:15.702015425 +0000 UTC m=+52.648471058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:09.780707 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.780635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx2pp" event={"ID":"e5870db0-8958-4913-8a6f-e5e696ab35bf","Type":"ContainerStarted","Data":"9e4035492815d6cec9b46ba06a2deed47fdb9b326b03e5a572dae8e9b12b31f1"} Jul 20 15:51:09.782669 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.782642 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" event={"ID":"ec6e20df-8416-4f82-84f0-2f78f572dc43","Type":"ContainerStarted","Data":"2b2ba91266c9bb60aa15389bf060fff9a87cc0fcba57826d3f8d61dc5b2ed726"} Jul 20 15:51:09.784408 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.784381 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" event={"ID":"e24fa95d-233e-489d-8afa-ef901fdcbbf9","Type":"ContainerStarted","Data":"3842985964be8131fa21b79ad6d044858f60dad3e174922e5ecc9ef5ff790371"} Jul 20 15:51:09.786457 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.786430 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/0.log" Jul 20 15:51:09.786558 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.786475 2585 generic.go:356] "Generic (PLEG): container finished" podID="204bc367-6913-4cfd-aec5-52555cba01b4" containerID="42e422075817393dcba36a5c9d32f0ca0f74047d932fe59c5a6bee16a295d73b" exitCode=255 Jul 20 15:51:09.786628 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.786556 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-822pj" event={"ID":"204bc367-6913-4cfd-aec5-52555cba01b4","Type":"ContainerDied","Data":"42e422075817393dcba36a5c9d32f0ca0f74047d932fe59c5a6bee16a295d73b"} Jul 20 15:51:09.786747 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.786729 2585 scope.go:117] "RemoveContainer" containerID="42e422075817393dcba36a5c9d32f0ca0f74047d932fe59c5a6bee16a295d73b" Jul 20 15:51:09.788147 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.788125 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" event={"ID":"9e4904ff-edd9-474d-abb9-08b494454108","Type":"ContainerStarted","Data":"ee62d6bb78479ca8fde6073186ef032886e24d6c44bd9f19e3f6139b4a61df89"} Jul 20 15:51:09.789681 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.789658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" event={"ID":"f6c10ad4-9606-4730-ab5d-8e0915396b71","Type":"ContainerStarted","Data":"ef1c246908c1dedff5ebe3790a4a722ce4c3bd552e26a7347d60060c89c6b03e"} Jul 20 15:51:09.813806 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.813750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gx2pp" podStartSLOduration=3.192597774 podStartE2EDuration="10.813726037s" totalImagesPullingTime="7.621128263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:09.797744363 +0000 UTC m=+46.744200023" watchObservedRunningTime="2026-07-20 15:51:09.813726037 +0000 UTC m=+46.760181690" Jul 20 15:51:09.839043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.837618 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" podStartSLOduration=15.217569446 podStartE2EDuration="22.837594966s" totalImagesPullingTime="7.62002552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:09.816557679 +0000 UTC m=+46.763013335" watchObservedRunningTime="2026-07-20 15:51:09.837594966 +0000 UTC m=+46.784050622" Jul 20 15:51:09.839043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.838689 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-5bmb5" podStartSLOduration=14.207814395 podStartE2EDuration="21.838671532s" totalImagesPullingTime="7.630857137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:09.837350126 +0000 UTC m=+46.783805783" watchObservedRunningTime="2026-07-20 15:51:09.838671532 +0000 UTC m=+46.785127185" Jul 20 15:51:09.856499 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.856146 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" podStartSLOduration=15.234438959 podStartE2EDuration="22.856124422s" totalImagesPullingTime="7.621685463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:09.85585323 +0000 UTC m=+46.802308886" watchObservedRunningTime="2026-07-20 15:51:09.856124422 +0000 UTC m=+46.802580080" Jul 20 15:51:09.894415 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:09.893336 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" podStartSLOduration=15.208021933 podStartE2EDuration="22.893300958s" totalImagesPullingTime="7.685279025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:09.891292269 +0000 UTC m=+46.837747926" watchObservedRunningTime="2026-07-20 15:51:09.893300958 +0000 UTC m=+46.839756615" Jul 20 15:51:10.272342 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.272297 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:10.272548 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.272370 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:10.578007 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.577904 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mzb9"] Jul 20 15:51:10.603065 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.603035 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mzb9"] Jul 20 15:51:10.603252 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.603190 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.606209 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.606178 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 15:51:10.606209 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.606199 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 15:51:10.606385 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.606185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2lnj\"" Jul 20 15:51:10.630380 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.630344 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phzsk\" (UniqueName: \"kubernetes.io/projected/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-api-access-phzsk\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.630564 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.630404 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.630564 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.630462 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.630564 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.630504 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-data-volume\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.630564 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.630533 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-crio-socket\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.731654 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.731615 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phzsk\" (UniqueName: \"kubernetes.io/projected/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-api-access-phzsk\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.731838 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.731668 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.731838 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:10.731742 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 15:51:10.731838 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:10.731812 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:11.231792648 +0000 UTC m=+48.178248299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : configmap "kube-rbac-proxy" not found Jul 20 15:51:10.732014 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.731844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.732014 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.731890 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-data-volume\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.732014 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.731920 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-crio-socket\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.735128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.732333 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-crio-socket\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.735128 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:10.732335 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 15:51:10.735128 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:10.732422 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:11.23239486 +0000 UTC m=+48.178850778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : secret "insights-runtime-extractor-tls" not found Jul 20 15:51:10.735128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.732656 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-data-volume\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.748242 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.748208 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt"] Jul 20 15:51:10.752450 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.752416 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phzsk\" (UniqueName: \"kubernetes.io/projected/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-api-access-phzsk\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:10.780036 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.779991 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt"] Jul 20 15:51:10.780234 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.780108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" Jul 20 15:51:10.783100 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.783060 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 15:51:10.783463 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.783128 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ttd9m\"" Jul 20 15:51:10.783556 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.783541 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 15:51:10.794597 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.794573 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/1.log" Jul 20 15:51:10.795054 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.795033 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/0.log" Jul 20 15:51:10.795216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.795075 2585 generic.go:356] "Generic (PLEG): container finished" podID="204bc367-6913-4cfd-aec5-52555cba01b4" containerID="014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2" exitCode=255 Jul 20 15:51:10.795216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.795194 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-822pj" event={"ID":"204bc367-6913-4cfd-aec5-52555cba01b4","Type":"ContainerDied","Data":"014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2"} Jul 20 15:51:10.795336 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.795254 2585 scope.go:117] "RemoveContainer" containerID="42e422075817393dcba36a5c9d32f0ca0f74047d932fe59c5a6bee16a295d73b" Jul 20 15:51:10.795468 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.795451 2585 scope.go:117] "RemoveContainer" containerID="014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2" Jul 20 15:51:10.795681 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:10.795652 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-822pj_openshift-console-operator(204bc367-6913-4cfd-aec5-52555cba01b4)\"" pod="openshift-console-operator/console-operator-565b7b569d-822pj" podUID="204bc367-6913-4cfd-aec5-52555cba01b4" Jul 20 15:51:10.833750 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.833553 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6zm\" (UniqueName: \"kubernetes.io/projected/ed7e7eeb-7ec5-4196-86cd-be5954a47462-kube-api-access-tp6zm\") pod \"migrator-7cc9c7ffd7-sbgxt\" (UID: \"ed7e7eeb-7ec5-4196-86cd-be5954a47462\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" Jul 20 15:51:10.934581 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.934535 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6zm\" (UniqueName: \"kubernetes.io/projected/ed7e7eeb-7ec5-4196-86cd-be5954a47462-kube-api-access-tp6zm\") pod \"migrator-7cc9c7ffd7-sbgxt\" (UID: \"ed7e7eeb-7ec5-4196-86cd-be5954a47462\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" Jul 20 15:51:10.943516 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:10.943483 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6zm\" (UniqueName: \"kubernetes.io/projected/ed7e7eeb-7ec5-4196-86cd-be5954a47462-kube-api-access-tp6zm\") pod \"migrator-7cc9c7ffd7-sbgxt\" (UID: \"ed7e7eeb-7ec5-4196-86cd-be5954a47462\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" Jul 20 15:51:11.090510 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.090418 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" Jul 20 15:51:11.237990 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.237946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:11.238202 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.238003 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:11.238202 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:11.238129 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 15:51:11.238202 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:11.238144 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 15:51:11.238324 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:11.238222 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:12.238203852 +0000 UTC m=+49.184659490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : configmap "kube-rbac-proxy" not found Jul 20 15:51:11.238324 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:11.238242 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:12.238234137 +0000 UTC m=+49.184689771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : secret "insights-runtime-extractor-tls" not found Jul 20 15:51:11.248988 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.248819 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt"] Jul 20 15:51:11.251813 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:11.251772 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7e7eeb_7ec5_4196_86cd_be5954a47462.slice/crio-932c538b62b2369f9237c1efd0af67281848d0ad694891a9f9941dbca1f4beb3 WatchSource:0}: Error finding container 932c538b62b2369f9237c1efd0af67281848d0ad694891a9f9941dbca1f4beb3: Status 404 returned error can't find the container with id 932c538b62b2369f9237c1efd0af67281848d0ad694891a9f9941dbca1f4beb3 Jul 20 15:51:11.799938 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.799912 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/1.log" Jul 20 15:51:11.800387 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.800283 2585 scope.go:117] "RemoveContainer" containerID="014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2" Jul 20 15:51:11.800519 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:11.800491 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-822pj_openshift-console-operator(204bc367-6913-4cfd-aec5-52555cba01b4)\"" pod="openshift-console-operator/console-operator-565b7b569d-822pj" podUID="204bc367-6913-4cfd-aec5-52555cba01b4" Jul 20 15:51:11.801110 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.801087 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" event={"ID":"ed7e7eeb-7ec5-4196-86cd-be5954a47462","Type":"ContainerStarted","Data":"932c538b62b2369f9237c1efd0af67281848d0ad694891a9f9941dbca1f4beb3"} Jul 20 15:51:11.984209 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:11.984177 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z99gh_ef623006-45c5-48e1-a7bf-463fc77a82ed/dns-node-resolver/0.log" Jul 20 15:51:12.248012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:12.247968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:12.248235 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:12.248028 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:12.248235 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:12.248099 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 15:51:12.248235 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:12.248193 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:14.248170808 +0000 UTC m=+51.194626458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : configmap "kube-rbac-proxy" not found Jul 20 15:51:12.248235 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:12.248200 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 15:51:12.248451 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:12.248250 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:14.248237668 +0000 UTC m=+51.194693301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : secret "insights-runtime-extractor-tls" not found Jul 20 15:51:12.784451 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:12.784424 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9td84_d6cfd7db-a1f8-4cd7-b99b-fca34c24987d/node-ca/0.log" Jul 20 15:51:13.384076 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:13.383997 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx2pp_e5870db0-8958-4913-8a6f-e5e696ab35bf/serve-healthcheck-canary/0.log" Jul 20 15:51:13.810143 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:13.810104 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" event={"ID":"ed7e7eeb-7ec5-4196-86cd-be5954a47462","Type":"ContainerStarted","Data":"3e3dbe7d7524e3dea5ab063ff8a115f20b9654281cb12101a639a41918156233"} Jul 20 15:51:13.810336 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:13.810186 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" event={"ID":"ed7e7eeb-7ec5-4196-86cd-be5954a47462","Type":"ContainerStarted","Data":"fe7624851308689e16aec989f3117e78b88ca366ca6731e8fcb82c126fa68703"} Jul 20 15:51:13.828837 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:13.828774 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sbgxt" podStartSLOduration=2.007407848 podStartE2EDuration="3.828753719s" totalImagesPullingTime="1.821345871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:13.828535781 +0000 UTC m=+50.774991436" watchObservedRunningTime="2026-07-20 15:51:13.828753719 +0000 UTC m=+50.775209375" Jul 20 15:51:14.268848 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:14.268815 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:14.269017 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:14.268869 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:14.269017 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:14.268961 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 15:51:14.269088 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:14.269044 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 15:51:14.269088 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:14.269049 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:18.269025393 +0000 UTC m=+55.215481040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : configmap "kube-rbac-proxy" not found Jul 20 15:51:14.269187 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:14.269099 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:18.269086851 +0000 UTC m=+55.215542483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : secret "insights-runtime-extractor-tls" not found Jul 20 15:51:15.781876 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.781834 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.781896 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.781927 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.781951 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.781970 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.781979 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782036 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls podName:bd21cd47-381b-46af-993e-d5a24caba364 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782020985 +0000 UTC m=+68.728476618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-84x4j" (UID: "bd21cd47-381b-46af-993e-d5a24caba364") : secret "cluster-monitoring-operator-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:15.782058 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782077 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782095 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79cfb66bcf-qxhnm: secret "image-registry-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782133 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782140 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls podName:337ea5a3-7c0c-4a58-a33c-a68d44c3353d nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782127905 +0000 UTC m=+68.728583541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls") pod "image-registry-79cfb66bcf-qxhnm" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d") : secret "image-registry-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782138 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782183 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782151019 +0000 UTC m=+68.728606652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : secret "router-metrics-certs-default" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782195 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls podName:9d4d0a46-8688-4312-9717-debba413e3c4 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782189423 +0000 UTC m=+68.728645056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls") pod "dns-default-ldhw9" (UID: "9d4d0a46-8688-4312-9717-debba413e3c4") : secret "dns-default-metrics-tls" not found Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782225 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle podName:b91d4e70-7530-4d0d-bb98-975cff1b2e25 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782211285 +0000 UTC m=+68.728666942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle") pod "router-default-59bf898cc6-pfftd" (UID: "b91d4e70-7530-4d0d-bb98-975cff1b2e25") : configmap references non-existent config key: service-ca.crt Jul 20 15:51:15.782289 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782287 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 20 15:51:15.782768 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:15.782327 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls podName:d7ab0453-cd1e-4355-b302-b20b40bead04 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:31.782317118 +0000 UTC m=+68.728772751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-d97j5" (UID: "d7ab0453-cd1e-4355-b302-b20b40bead04") : secret "samples-operator-tls" not found Jul 20 15:51:18.309011 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:18.308964 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:18.309011 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:18.309022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:18.309538 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:18.309109 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 15:51:18.309538 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:18.309185 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls podName:4cd9209d-cee4-44c6-becf-1d64b0c6ef6a nodeName:}" failed. No retries permitted until 2026-07-20 15:51:26.30914993 +0000 UTC m=+63.255605564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mzb9" (UID: "4cd9209d-cee4-44c6-becf-1d64b0c6ef6a") : secret "insights-runtime-extractor-tls" not found Jul 20 15:51:18.309611 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:18.309555 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:20.271975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.271933 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:20.272466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.272005 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:20.272466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.272417 2585 scope.go:117] "RemoveContainer" containerID="014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2" Jul 20 15:51:20.834597 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.834570 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 15:51:20.834975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.834950 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/1.log" Jul 20 15:51:20.835072 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.834992 2585 generic.go:356] "Generic (PLEG): container finished" podID="204bc367-6913-4cfd-aec5-52555cba01b4" containerID="4216f795bc44c58f24748bb03ce0e98fad680e7299915cfa25d03bb22489c0b3" exitCode=255 Jul 20 15:51:20.835072 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.835026 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-822pj" event={"ID":"204bc367-6913-4cfd-aec5-52555cba01b4","Type":"ContainerDied","Data":"4216f795bc44c58f24748bb03ce0e98fad680e7299915cfa25d03bb22489c0b3"} Jul 20 15:51:20.835072 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.835066 2585 scope.go:117] "RemoveContainer" containerID="014d8c235c3f13c3c14155567894e2fbc90f132f8c4c25d2f318acd69b3d34d2" Jul 20 15:51:20.835424 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:20.835406 2585 scope.go:117] "RemoveContainer" containerID="4216f795bc44c58f24748bb03ce0e98fad680e7299915cfa25d03bb22489c0b3" Jul 20 15:51:20.835596 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:20.835577 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-822pj_openshift-console-operator(204bc367-6913-4cfd-aec5-52555cba01b4)\"" pod="openshift-console-operator/console-operator-565b7b569d-822pj" podUID="204bc367-6913-4cfd-aec5-52555cba01b4" Jul 20 15:51:21.840518 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:21.840488 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 15:51:25.721356 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:25.721321 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgj6v" Jul 20 15:51:26.380012 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.379963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:26.382371 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.382350 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cd9209d-cee4-44c6-becf-1d64b0c6ef6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mzb9\" (UID: \"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a\") " pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:26.516269 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.516234 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2lnj\"" Jul 20 15:51:26.523260 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.523233 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mzb9" Jul 20 15:51:26.671376 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.671299 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mzb9"] Jul 20 15:51:26.674213 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:26.674184 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd9209d_cee4_44c6_becf_1d64b0c6ef6a.slice/crio-b6f9728dbfb1dd27eadcb1565723ba1ec48beb72863d9e5ac288011df673daa5 WatchSource:0}: Error finding container b6f9728dbfb1dd27eadcb1565723ba1ec48beb72863d9e5ac288011df673daa5: Status 404 returned error can't find the container with id b6f9728dbfb1dd27eadcb1565723ba1ec48beb72863d9e5ac288011df673daa5 Jul 20 15:51:26.857693 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:26.857654 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mzb9" event={"ID":"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a","Type":"ContainerStarted","Data":"b6f9728dbfb1dd27eadcb1565723ba1ec48beb72863d9e5ac288011df673daa5"} Jul 20 15:51:29.208624 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.208587 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:51:29.209089 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.208682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:51:29.211690 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.211481 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 15:51:29.211690 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.211523 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 15:51:29.222018 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.221986 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb63bde8-6d03-403d-8886-7b806aa6ca33-original-pull-secret\") pod \"global-pull-secret-syncer-6nfmm\" (UID: \"bb63bde8-6d03-403d-8886-7b806aa6ca33\") " pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:51:29.222315 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.222295 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ce0d48b-a392-4737-9690-a5f8f3ff3c83-metrics-certs\") pod \"network-metrics-daemon-zkqjw\" (UID: \"6ce0d48b-a392-4737-9690-a5f8f3ff3c83\") " pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:51:29.309566 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.309528 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:51:29.312502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.312473 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvkk\" (UniqueName: \"kubernetes.io/projected/ad2979fa-0c82-4749-98a7-10b1cdd27058-kube-api-access-mbvkk\") pod \"network-check-target-vqlgj\" (UID: \"ad2979fa-0c82-4749-98a7-10b1cdd27058\") " pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:51:29.448204 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.448149 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6j7cm\"" Jul 20 15:51:29.453794 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.453766 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nfmm" Jul 20 15:51:29.455924 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.455889 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:51:29.469057 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.469032 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7vt6p\"" Jul 20 15:51:29.476447 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:29.476420 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zkqjw" Jul 20 15:51:30.271977 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:30.271940 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:30.272410 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:30.272013 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:30.272466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:30.272421 2585 scope.go:117] "RemoveContainer" containerID="4216f795bc44c58f24748bb03ce0e98fad680e7299915cfa25d03bb22489c0b3" Jul 20 15:51:30.272613 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:30.272589 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-822pj_openshift-console-operator(204bc367-6913-4cfd-aec5-52555cba01b4)\"" pod="openshift-console-operator/console-operator-565b7b569d-822pj" podUID="204bc367-6913-4cfd-aec5-52555cba01b4" Jul 20 15:51:31.664968 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.664940 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zkqjw"] Jul 20 15:51:31.668878 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:31.668849 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce0d48b_a392_4737_9690_a5f8f3ff3c83.slice/crio-0c14f12c48df616a4b1676815fd5892694895d5aef052f8b35219f56fd386cfb WatchSource:0}: Error finding container 0c14f12c48df616a4b1676815fd5892694895d5aef052f8b35219f56fd386cfb: Status 404 returned error can't find the container with id 0c14f12c48df616a4b1676815fd5892694895d5aef052f8b35219f56fd386cfb Jul 20 15:51:31.833904 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833806 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:31.833904 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833858 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:31.833904 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833882 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:31.834145 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833916 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:31.834145 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:31.834145 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.833978 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:31.834812 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.834783 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91d4e70-7530-4d0d-bb98-975cff1b2e25-service-ca-bundle\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:31.836518 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.836486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d4d0a46-8688-4312-9717-debba413e3c4-metrics-tls\") pod \"dns-default-ldhw9\" (UID: \"9d4d0a46-8688-4312-9717-debba413e3c4\") " pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:31.836644 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.836626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd21cd47-381b-46af-993e-d5a24caba364-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-84x4j\" (UID: \"bd21cd47-381b-46af-993e-d5a24caba364\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:31.836697 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.836628 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7ab0453-cd1e-4355-b302-b20b40bead04-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-d97j5\" (UID: \"d7ab0453-cd1e-4355-b302-b20b40bead04\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:31.836899 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.836879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b91d4e70-7530-4d0d-bb98-975cff1b2e25-metrics-certs\") pod \"router-default-59bf898cc6-pfftd\" (UID: \"b91d4e70-7530-4d0d-bb98-975cff1b2e25\") " pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:31.836940 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.836879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"image-registry-79cfb66bcf-qxhnm\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:31.877703 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.877670 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkqjw" event={"ID":"6ce0d48b-a392-4737-9690-a5f8f3ff3c83","Type":"ContainerStarted","Data":"0c14f12c48df616a4b1676815fd5892694895d5aef052f8b35219f56fd386cfb"} Jul 20 15:51:31.879038 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.879007 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mzb9" event={"ID":"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a","Type":"ContainerStarted","Data":"c4f77ecba5e29e6b3a5dcb8554afa4c970985c2ababf12e40b95104a7e514689"} Jul 20 15:51:31.884337 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.884317 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nfmm"] Jul 20 15:51:31.886752 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:31.886722 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb63bde8_6d03_403d_8886_7b806aa6ca33.slice/crio-38582b0a3da9688c03e642803713fc5c16e0a5a09aee89e6f9d42f3a1c7b04c2 WatchSource:0}: Error finding container 38582b0a3da9688c03e642803713fc5c16e0a5a09aee89e6f9d42f3a1c7b04c2: Status 404 returned error can't find the container with id 38582b0a3da9688c03e642803713fc5c16e0a5a09aee89e6f9d42f3a1c7b04c2 Jul 20 15:51:31.887175 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.887080 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vqlgj"] Jul 20 15:51:31.889509 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:31.889473 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2979fa_0c82_4749_98a7_10b1cdd27058.slice/crio-6bf9f9e15ac81a6fa495b004f87348df65083c9a24b479ffc558eaa606aedf1c WatchSource:0}: Error finding container 6bf9f9e15ac81a6fa495b004f87348df65083c9a24b479ffc558eaa606aedf1c: Status 404 returned error can't find the container with id 6bf9f9e15ac81a6fa495b004f87348df65083c9a24b479ffc558eaa606aedf1c Jul 20 15:51:31.990030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.990000 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-js84c\"" Jul 20 15:51:31.997462 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:31.997441 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:32.046289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.046257 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mkslq\"" Jul 20 15:51:32.054015 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.053943 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:32.059856 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.059823 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h5v5w\"" Jul 20 15:51:32.066231 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.066207 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b44jg\"" Jul 20 15:51:32.068287 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.068265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" Jul 20 15:51:32.074611 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.074566 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" Jul 20 15:51:32.080994 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.080970 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5lhc8\"" Jul 20 15:51:32.089097 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.089022 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:32.146632 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.146558 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:51:32.151338 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:32.151308 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337ea5a3_7c0c_4a58_a33c_a68d44c3353d.slice/crio-fe6c732b3a97b73ac3bd570d508bcccdbc65a3667657cb2bd5c9bd023a8e5bec WatchSource:0}: Error finding container fe6c732b3a97b73ac3bd570d508bcccdbc65a3667657cb2bd5c9bd023a8e5bec: Status 404 returned error can't find the container with id fe6c732b3a97b73ac3bd570d508bcccdbc65a3667657cb2bd5c9bd023a8e5bec Jul 20 15:51:32.266884 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.266797 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59bf898cc6-pfftd"] Jul 20 15:51:32.272197 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:32.272126 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d4e70_7530_4d0d_bb98_975cff1b2e25.slice/crio-87c0e08f6b1dc41c121a1afbf8f15f530327b788f65f59cb5a09da0a1243de24 WatchSource:0}: Error finding container 87c0e08f6b1dc41c121a1afbf8f15f530327b788f65f59cb5a09da0a1243de24: Status 404 returned error can't find the container with id 87c0e08f6b1dc41c121a1afbf8f15f530327b788f65f59cb5a09da0a1243de24 Jul 20 15:51:32.289133 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.289104 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5"] Jul 20 15:51:32.317381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.317352 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldhw9"] Jul 20 15:51:32.323619 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:32.323580 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4d0a46_8688_4312_9717_debba413e3c4.slice/crio-4d0505967926e91237e2a4d3fc1fcac73e9232726b7c80989a6db4f3cddcca7a WatchSource:0}: Error finding container 4d0505967926e91237e2a4d3fc1fcac73e9232726b7c80989a6db4f3cddcca7a: Status 404 returned error can't find the container with id 4d0505967926e91237e2a4d3fc1fcac73e9232726b7c80989a6db4f3cddcca7a Jul 20 15:51:32.339843 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.339778 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j"] Jul 20 15:51:32.342538 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:32.342505 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd21cd47_381b_46af_993e_d5a24caba364.slice/crio-aa04caa42830134093c91859560e08aed4937d35a1b8248e61fbfb3cea30264c WatchSource:0}: Error finding container aa04caa42830134093c91859560e08aed4937d35a1b8248e61fbfb3cea30264c: Status 404 returned error can't find the container with id aa04caa42830134093c91859560e08aed4937d35a1b8248e61fbfb3cea30264c Jul 20 15:51:32.885464 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.885429 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" event={"ID":"bd21cd47-381b-46af-993e-d5a24caba364","Type":"ContainerStarted","Data":"aa04caa42830134093c91859560e08aed4937d35a1b8248e61fbfb3cea30264c"} Jul 20 15:51:32.886852 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.886805 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldhw9" event={"ID":"9d4d0a46-8688-4312-9717-debba413e3c4","Type":"ContainerStarted","Data":"4d0505967926e91237e2a4d3fc1fcac73e9232726b7c80989a6db4f3cddcca7a"} Jul 20 15:51:32.889683 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.888788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59bf898cc6-pfftd" event={"ID":"b91d4e70-7530-4d0d-bb98-975cff1b2e25","Type":"ContainerStarted","Data":"465656f39f91ae2f58fe75c82c073356f2170f50f5aa42bae3252148f7bcb547"} Jul 20 15:51:32.889683 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.888843 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59bf898cc6-pfftd" event={"ID":"b91d4e70-7530-4d0d-bb98-975cff1b2e25","Type":"ContainerStarted","Data":"87c0e08f6b1dc41c121a1afbf8f15f530327b788f65f59cb5a09da0a1243de24"} Jul 20 15:51:32.893483 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.892448 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" event={"ID":"337ea5a3-7c0c-4a58-a33c-a68d44c3353d","Type":"ContainerStarted","Data":"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1"} Jul 20 15:51:32.893483 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.892506 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" event={"ID":"337ea5a3-7c0c-4a58-a33c-a68d44c3353d","Type":"ContainerStarted","Data":"fe6c732b3a97b73ac3bd570d508bcccdbc65a3667657cb2bd5c9bd023a8e5bec"} Jul 20 15:51:32.893483 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.893111 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:32.894398 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.894364 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nfmm" event={"ID":"bb63bde8-6d03-403d-8886-7b806aa6ca33","Type":"ContainerStarted","Data":"38582b0a3da9688c03e642803713fc5c16e0a5a09aee89e6f9d42f3a1c7b04c2"} Jul 20 15:51:32.897001 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.896969 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" event={"ID":"d7ab0453-cd1e-4355-b302-b20b40bead04","Type":"ContainerStarted","Data":"d57e90e1a2e6fc1e062a55c4ece196d936c63f318e822f51c58d3605ae09db0d"} Jul 20 15:51:32.902463 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.902379 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqlgj" event={"ID":"ad2979fa-0c82-4749-98a7-10b1cdd27058","Type":"ContainerStarted","Data":"8ff589014a295981c21c2056b7e706514b2a6962a5ad34a7eabe8e0a66620951"} Jul 20 15:51:32.902463 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.902430 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vqlgj" event={"ID":"ad2979fa-0c82-4749-98a7-10b1cdd27058","Type":"ContainerStarted","Data":"6bf9f9e15ac81a6fa495b004f87348df65083c9a24b479ffc558eaa606aedf1c"} Jul 20 15:51:32.902737 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.902696 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:51:32.913352 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.912072 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59bf898cc6-pfftd" podStartSLOduration=45.912046907 podStartE2EDuration="45.912046907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:32.910470225 +0000 UTC m=+69.856925879" watchObservedRunningTime="2026-07-20 15:51:32.912046907 +0000 UTC m=+69.858502564" Jul 20 15:51:32.928023 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.927581 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vqlgj" podStartSLOduration=68.927557068 podStartE2EDuration="1m8.927557068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:32.925924207 +0000 UTC m=+69.872379863" watchObservedRunningTime="2026-07-20 15:51:32.927557068 +0000 UTC m=+69.874012726" Jul 20 15:51:32.945202 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:32.945109 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" podStartSLOduration=67.945087182 podStartE2EDuration="1m7.945087182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:32.944333949 +0000 UTC m=+69.890789612" watchObservedRunningTime="2026-07-20 15:51:32.945087182 +0000 UTC m=+69.891542838" Jul 20 15:51:33.054455 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:33.054379 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:33.057819 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:33.057606 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:33.913282 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:33.913234 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkqjw" event={"ID":"6ce0d48b-a392-4737-9690-a5f8f3ff3c83","Type":"ContainerStarted","Data":"7585e5b2638ceec93b9630f8fec0b3c9b1e02f87c715ddd8084b63b45c2edcb5"} Jul 20 15:51:33.913752 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:33.913514 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:33.914969 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:33.914945 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59bf898cc6-pfftd" Jul 20 15:51:34.919655 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:34.919585 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zkqjw" event={"ID":"6ce0d48b-a392-4737-9690-a5f8f3ff3c83","Type":"ContainerStarted","Data":"16ab46eaee1b35b402712fd238d0361e24448b150b44877cee16b066c6a6c8ce"} Jul 20 15:51:34.939230 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:34.939177 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zkqjw" podStartSLOduration=68.935141657 podStartE2EDuration="1m10.939137437s" totalImagesPullingTime="2.00399578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:34.938527084 +0000 UTC m=+71.884982739" watchObservedRunningTime="2026-07-20 15:51:34.939137437 +0000 UTC m=+71.885593089" Jul 20 15:51:35.661481 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.661450 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n"] Jul 20 15:51:35.680084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.680050 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.684534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.684218 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j98vr\"" Jul 20 15:51:35.684534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.684241 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 20 15:51:35.684534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.684244 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 20 15:51:35.702811 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.702778 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n"] Jul 20 15:51:35.773763 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.773731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.773924 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.773779 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.874786 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.874693 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.874786 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.874756 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.875555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.875524 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.877539 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.877512 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb3eedb9-77b7-4bf2-910b-6d60dab371b4-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-cq86n\" (UID: \"fb3eedb9-77b7-4bf2-910b-6d60dab371b4\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:35.992219 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:35.992176 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" Jul 20 15:51:39.517540 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.516674 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n"] Jul 20 15:51:39.942534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.942491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldhw9" event={"ID":"9d4d0a46-8688-4312-9717-debba413e3c4","Type":"ContainerStarted","Data":"17f8a4360570b7b3295914c4440d1936de95aaec4dc63f12a397751ba4b31eb8"} Jul 20 15:51:39.942741 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.942566 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldhw9" event={"ID":"9d4d0a46-8688-4312-9717-debba413e3c4","Type":"ContainerStarted","Data":"e87dee247fd915d473d395f1c5cab66d3e8bc7164379b849b4cf682e0eb795c7"} Jul 20 15:51:39.944075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.944043 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nfmm" event={"ID":"bb63bde8-6d03-403d-8886-7b806aa6ca33","Type":"ContainerStarted","Data":"ac1393754edb54ebcb70acee5dba5517ca6fdd04eac8d5c4d87f7b31c5346038"} Jul 20 15:51:39.945892 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.945867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" event={"ID":"d7ab0453-cd1e-4355-b302-b20b40bead04","Type":"ContainerStarted","Data":"a2e55e5ed2e19e024959b6fe1131ad6324b49428c0574fbb35f26ae3765fc5d6"} Jul 20 15:51:39.946005 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.945917 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" event={"ID":"d7ab0453-cd1e-4355-b302-b20b40bead04","Type":"ContainerStarted","Data":"c360f0c901ccb3e7944ab481056385015b6cd824f916bba08d1d381a229175bf"} Jul 20 15:51:39.947230 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.947206 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" event={"ID":"fb3eedb9-77b7-4bf2-910b-6d60dab371b4","Type":"ContainerStarted","Data":"2aab4c409f4cf363d3436c28c031db11a3a4c6d83d2eab4fc387f45d7fb398b6"} Jul 20 15:51:39.949026 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.949002 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mzb9" event={"ID":"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a","Type":"ContainerStarted","Data":"a82a7ba7ccf1a7aa9caa925fc289838f7dbec61a3f225b1d69b5ee4a3e68355f"} Jul 20 15:51:39.950516 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.950495 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" event={"ID":"bd21cd47-381b-46af-993e-d5a24caba364","Type":"ContainerStarted","Data":"2c35895ec6eaacea146cad5605df6cf66ae3ed5f6e156dff278fb64d9752f363"} Jul 20 15:51:39.962710 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.962665 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ldhw9" podStartSLOduration=33.946115276 podStartE2EDuration="40.96265018s" totalImagesPullingTime="7.016534904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:39.962362128 +0000 UTC m=+76.908817783" watchObservedRunningTime="2026-07-20 15:51:39.96265018 +0000 UTC m=+76.909105834" Jul 20 15:51:39.985055 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.984999 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-84x4j" podStartSLOduration=45.986841234 podStartE2EDuration="52.984979556s" totalImagesPullingTime="6.998138322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:39.984308724 +0000 UTC m=+76.930764373" watchObservedRunningTime="2026-07-20 15:51:39.984979556 +0000 UTC m=+76.931435189" Jul 20 15:51:39.989438 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:39.989407 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb"] Jul 20 15:51:40.005439 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.005381 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6nfmm" podStartSLOduration=68.529741413 podStartE2EDuration="1m16.005357482s" totalImagesPullingTime="7.475616069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:50:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:40.00469306 +0000 UTC m=+76.951148716" watchObservedRunningTime="2026-07-20 15:51:40.005357482 +0000 UTC m=+76.951813138" Jul 20 15:51:40.014667 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.014633 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb"] Jul 20 15:51:40.014824 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.014754 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:40.017279 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.017256 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 15:51:40.017415 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.017264 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tt89l\"" Jul 20 15:51:40.024623 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.024577 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-d97j5" podStartSLOduration=46.026926462 podStartE2EDuration="53.024560949s" totalImagesPullingTime="6.997634487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:40.023095228 +0000 UTC m=+76.969550886" watchObservedRunningTime="2026-07-20 15:51:40.024560949 +0000 UTC m=+76.971016655" Jul 20 15:51:40.112848 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.112699 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/132e3f29-1dcf-4ebd-9375-7c6b592735bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q8zcb\" (UID: \"132e3f29-1dcf-4ebd-9375-7c6b592735bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:40.214078 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.213985 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/132e3f29-1dcf-4ebd-9375-7c6b592735bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q8zcb\" (UID: \"132e3f29-1dcf-4ebd-9375-7c6b592735bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:40.217529 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.217496 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/132e3f29-1dcf-4ebd-9375-7c6b592735bc-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-q8zcb\" (UID: \"132e3f29-1dcf-4ebd-9375-7c6b592735bc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:40.324420 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.324383 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:40.511127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.511046 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb"] Jul 20 15:51:40.513745 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:40.513703 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132e3f29_1dcf_4ebd_9375_7c6b592735bc.slice/crio-2d76168da5940c0198dfa335b0e88934b8542f40b969e408abe33ed1c467b0d3 WatchSource:0}: Error finding container 2d76168da5940c0198dfa335b0e88934b8542f40b969e408abe33ed1c467b0d3: Status 404 returned error can't find the container with id 2d76168da5940c0198dfa335b0e88934b8542f40b969e408abe33ed1c467b0d3 Jul 20 15:51:40.969916 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.969872 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" event={"ID":"132e3f29-1dcf-4ebd-9375-7c6b592735bc","Type":"ContainerStarted","Data":"2d76168da5940c0198dfa335b0e88934b8542f40b969e408abe33ed1c467b0d3"} Jul 20 15:51:40.970667 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:40.970641 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:43.536036 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:43.535996 2585 scope.go:117] "RemoveContainer" containerID="4216f795bc44c58f24748bb03ce0e98fad680e7299915cfa25d03bb22489c0b3" Jul 20 15:51:44.988529 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.988495 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" event={"ID":"fb3eedb9-77b7-4bf2-910b-6d60dab371b4","Type":"ContainerStarted","Data":"ed703ffa1d0cc7c218d192686ccd7c77e6c608f8498ac8c3cb75d913531c9e82"} Jul 20 15:51:44.990182 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.990127 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" event={"ID":"132e3f29-1dcf-4ebd-9375-7c6b592735bc","Type":"ContainerStarted","Data":"635b450d8c2818332f1bb771916fa5a74de0f256c60391977559c2339de908a8"} Jul 20 15:51:44.990298 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.990202 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:44.992893 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.992616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mzb9" event={"ID":"4cd9209d-cee4-44c6-becf-1d64b0c6ef6a","Type":"ContainerStarted","Data":"77757120bacdd86cb2da9818bfbca66248178cef5752f7dd992b783605a77cb0"} Jul 20 15:51:44.994800 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.994776 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 15:51:44.994912 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.994836 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-822pj" event={"ID":"204bc367-6913-4cfd-aec5-52555cba01b4","Type":"ContainerStarted","Data":"2b3d5b032c8b5519075f395fd11e3a08c6fa042fbdf7bc8443f936bcedf739b0"} Jul 20 15:51:44.995095 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.995079 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:44.996167 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.996128 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" Jul 20 15:51:44.999738 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:44.999714 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-822pj" Jul 20 15:51:45.029846 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:45.029790 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-cq86n" podStartSLOduration=5.470420103 podStartE2EDuration="10.029773784s" totalImagesPullingTime="4.559353681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:45.028605831 +0000 UTC m=+81.975061487" watchObservedRunningTime="2026-07-20 15:51:45.029773784 +0000 UTC m=+81.976229438" Jul 20 15:51:45.059197 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:45.059123 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-822pj" podStartSLOduration=50.438688891 podStartE2EDuration="58.05910743s" totalImagesPullingTime="7.620418539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:45.05892544 +0000 UTC m=+82.005381096" watchObservedRunningTime="2026-07-20 15:51:45.05910743 +0000 UTC m=+82.005563084" Jul 20 15:51:45.080204 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:45.080129 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mzb9" podStartSLOduration=17.835980599 podStartE2EDuration="35.080107219s" totalImagesPullingTime="17.24412662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:51:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:45.079633103 +0000 UTC m=+82.026088758" watchObservedRunningTime="2026-07-20 15:51:45.080107219 +0000 UTC m=+82.026562877" Jul 20 15:51:45.104488 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:45.104415 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-q8zcb" podStartSLOduration=2.51029568 podStartE2EDuration="6.104398312s" totalImagesPullingTime="3.594102632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:45.103419561 +0000 UTC m=+82.049875216" watchObservedRunningTime="2026-07-20 15:51:45.104398312 +0000 UTC m=+82.050853967" Jul 20 15:51:50.976296 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:50.976196 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ldhw9" Jul 20 15:51:54.924660 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:54.924631 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:51:55.498621 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.498586 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l4vmg"] Jul 20 15:51:55.501996 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.501974 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.504941 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.504919 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 15:51:55.505176 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.505147 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cxvjb\"" Jul 20 15:51:55.505284 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.505266 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 15:51:55.505410 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.505392 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 15:51:55.506386 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.506370 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 15:51:55.525472 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525440 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-sys\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525496 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-textfile\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525574 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-root\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525646 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525670 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-metrics-client-ca\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525689 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-wtmp\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.525836 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.525732 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wjtl\" (UniqueName: \"kubernetes.io/projected/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-kube-api-access-2wjtl\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626591 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626554 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-wtmp\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626591 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wjtl\" (UniqueName: \"kubernetes.io/projected/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-kube-api-access-2wjtl\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626636 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626671 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-sys\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626693 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-textfile\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626727 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626749 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-wtmp\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626762 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-root\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.626798 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626777 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-sys\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626841 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-root\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627127 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.626847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-metrics-client-ca\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:55.626954 2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 15:51:55.627127 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:51:55.627049 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls podName:57867bbd-0eeb-4125-85cd-86f6f9f99bd2 nodeName:}" failed. No retries permitted until 2026-07-20 15:51:56.127025047 +0000 UTC m=+93.073480696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls") pod "node-exporter-l4vmg" (UID: "57867bbd-0eeb-4125-85cd-86f6f9f99bd2") : secret "node-exporter-tls" not found Jul 20 15:51:55.627380 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.627259 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-textfile\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627513 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.627491 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-metrics-client-ca\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.627556 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.627491 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.629164 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.629136 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:55.638683 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:55.638651 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wjtl\" (UniqueName: \"kubernetes.io/projected/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-kube-api-access-2wjtl\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:56.129534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:56.129495 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:56.131937 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:56.131913 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57867bbd-0eeb-4125-85cd-86f6f9f99bd2-node-exporter-tls\") pod \"node-exporter-l4vmg\" (UID: \"57867bbd-0eeb-4125-85cd-86f6f9f99bd2\") " pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:56.411443 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:56.411359 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l4vmg" Jul 20 15:51:56.422272 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:51:56.422247 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57867bbd_0eeb_4125_85cd_86f6f9f99bd2.slice/crio-9dc83c6cd70cb4a97ed9e16e523bb351c4f6e13d32fc6225aee8ebb3d1a21000 WatchSource:0}: Error finding container 9dc83c6cd70cb4a97ed9e16e523bb351c4f6e13d32fc6225aee8ebb3d1a21000: Status 404 returned error can't find the container with id 9dc83c6cd70cb4a97ed9e16e523bb351c4f6e13d32fc6225aee8ebb3d1a21000 Jul 20 15:51:57.044377 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:57.044338 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l4vmg" event={"ID":"57867bbd-0eeb-4125-85cd-86f6f9f99bd2","Type":"ContainerStarted","Data":"9dc83c6cd70cb4a97ed9e16e523bb351c4f6e13d32fc6225aee8ebb3d1a21000"} Jul 20 15:51:58.049428 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:58.049391 2585 generic.go:356] "Generic (PLEG): container finished" podID="57867bbd-0eeb-4125-85cd-86f6f9f99bd2" containerID="842f470065dccec1b26a08e586daffbc7a4bf294883e30e4965d74ba787c8aef" exitCode=0 Jul 20 15:51:58.049912 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:58.049479 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l4vmg" event={"ID":"57867bbd-0eeb-4125-85cd-86f6f9f99bd2","Type":"ContainerDied","Data":"842f470065dccec1b26a08e586daffbc7a4bf294883e30e4965d74ba787c8aef"} Jul 20 15:51:59.055619 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:59.055585 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l4vmg" event={"ID":"57867bbd-0eeb-4125-85cd-86f6f9f99bd2","Type":"ContainerStarted","Data":"34bbdd249de473d33fbe2d30038c444433bb0917bcc00622452f1375829decb7"} Jul 20 15:51:59.056006 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:59.055640 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l4vmg" event={"ID":"57867bbd-0eeb-4125-85cd-86f6f9f99bd2","Type":"ContainerStarted","Data":"95e110bb76ff0bda17422f9eb2b4d40f69e981ef27f17e78204cf44d4a8b16e4"} Jul 20 15:51:59.076499 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:59.076447 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l4vmg" podStartSLOduration=3.208061419 podStartE2EDuration="4.076433935s" totalImagesPullingTime="803.32072ms" totalInitContainerRuntime="65.051796ms" isStatefulPod=true podCreationTimestamp="2026-07-20 15:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:51:59.075126034 +0000 UTC m=+96.021581690" watchObservedRunningTime="2026-07-20 15:51:59.076433935 +0000 UTC m=+96.022889589" Jul 20 15:51:59.312339 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:51:59.312251 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:52:03.915975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:03.915944 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vqlgj" Jul 20 15:52:16.121105 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:16.121070 2585 generic.go:356] "Generic (PLEG): container finished" podID="f6c10ad4-9606-4730-ab5d-8e0915396b71" containerID="ef1c246908c1dedff5ebe3790a4a722ce4c3bd552e26a7347d60060c89c6b03e" exitCode=0 Jul 20 15:52:16.121569 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:16.121146 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" event={"ID":"f6c10ad4-9606-4730-ab5d-8e0915396b71","Type":"ContainerDied","Data":"ef1c246908c1dedff5ebe3790a4a722ce4c3bd552e26a7347d60060c89c6b03e"} Jul 20 15:52:16.121569 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:16.121475 2585 scope.go:117] "RemoveContainer" containerID="ef1c246908c1dedff5ebe3790a4a722ce4c3bd552e26a7347d60060c89c6b03e" Jul 20 15:52:17.126561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:17.126524 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-lqfmf" event={"ID":"f6c10ad4-9606-4730-ab5d-8e0915396b71","Type":"ContainerStarted","Data":"0e297f227d3988312da0d4a4892fa53705cffed0f38b12fa3a15fb8e741c4876"} Jul 20 15:52:24.332967 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.332901 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" podUID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" containerName="registry" containerID="cri-o://1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1" gracePeriod=30 Jul 20 15:52:24.573147 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.573121 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:52:24.655767 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655675 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.655767 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655714 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.655767 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655751 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656041 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655833 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9l2b\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656041 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655874 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656041 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655901 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656041 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655925 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656041 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.655988 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets\") pod \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\" (UID: \"337ea5a3-7c0c-4a58-a33c-a68d44c3353d\") " Jul 20 15:52:24.656365 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.656188 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 15:52:24.656365 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.656326 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 15:52:24.658579 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.658539 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 15:52:24.658709 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.658657 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:52:24.658709 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.658701 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 15:52:24.658822 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.658753 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:52:24.658858 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.658814 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b" (OuterVolumeSpecName: "kube-api-access-r9l2b") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "kube-api-access-r9l2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:52:24.665028 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.665000 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "337ea5a3-7c0c-4a58-a33c-a68d44c3353d" (UID: "337ea5a3-7c0c-4a58-a33c-a68d44c3353d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:52:24.757084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757050 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9l2b\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-kube-api-access-r9l2b\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757080 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-tls\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757090 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-bound-sa-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757098 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-ca-trust-extracted\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757107 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-installation-pull-secrets\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757115 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-trusted-ca\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757123 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-registry-certificates\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:24.757295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:24.757133 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/337ea5a3-7c0c-4a58-a33c-a68d44c3353d-image-registry-private-configuration\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:52:25.157656 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.157624 2585 generic.go:356] "Generic (PLEG): container finished" podID="9e4904ff-edd9-474d-abb9-08b494454108" containerID="ee62d6bb78479ca8fde6073186ef032886e24d6c44bd9f19e3f6139b4a61df89" exitCode=0 Jul 20 15:52:25.157828 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.157701 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" event={"ID":"9e4904ff-edd9-474d-abb9-08b494454108","Type":"ContainerDied","Data":"ee62d6bb78479ca8fde6073186ef032886e24d6c44bd9f19e3f6139b4a61df89"} Jul 20 15:52:25.158090 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.158057 2585 scope.go:117] "RemoveContainer" containerID="ee62d6bb78479ca8fde6073186ef032886e24d6c44bd9f19e3f6139b4a61df89" Jul 20 15:52:25.159115 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.159089 2585 generic.go:356] "Generic (PLEG): container finished" podID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" containerID="1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1" exitCode=0 Jul 20 15:52:25.159230 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.159126 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" Jul 20 15:52:25.159230 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.159146 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" event={"ID":"337ea5a3-7c0c-4a58-a33c-a68d44c3353d","Type":"ContainerDied","Data":"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1"} Jul 20 15:52:25.159230 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.159212 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79cfb66bcf-qxhnm" event={"ID":"337ea5a3-7c0c-4a58-a33c-a68d44c3353d","Type":"ContainerDied","Data":"fe6c732b3a97b73ac3bd570d508bcccdbc65a3667657cb2bd5c9bd023a8e5bec"} Jul 20 15:52:25.159403 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.159239 2585 scope.go:117] "RemoveContainer" containerID="1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1" Jul 20 15:52:25.168673 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.168650 2585 scope.go:117] "RemoveContainer" containerID="1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1" Jul 20 15:52:25.168973 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:52:25.168946 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1\": container with ID starting with 1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1 not found: ID does not exist" containerID="1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1" Jul 20 15:52:25.169051 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.168981 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1"} err="failed to get container status \"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1\": rpc error: code = NotFound desc = could not find container \"1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1\": container with ID starting with 1c125b79dd5c617c032a879f9f04ccfa17209ea21099a7fcfa3a00a8cd8bb3f1 not found: ID does not exist" Jul 20 15:52:25.216347 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.216314 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:52:25.223980 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.223940 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79cfb66bcf-qxhnm"] Jul 20 15:52:25.544792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:25.544757 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" path="/var/lib/kubelet/pods/337ea5a3-7c0c-4a58-a33c-a68d44c3353d/volumes" Jul 20 15:52:26.166020 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:26.165988 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-zwcjg" event={"ID":"9e4904ff-edd9-474d-abb9-08b494454108","Type":"ContainerStarted","Data":"38c81546429643c188746e6d86871e0790541d5d19eee483a87a4784c8a632f1"} Jul 20 15:52:30.182644 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:30.182611 2585 generic.go:356] "Generic (PLEG): container finished" podID="ec6e20df-8416-4f82-84f0-2f78f572dc43" containerID="2b2ba91266c9bb60aa15389bf060fff9a87cc0fcba57826d3f8d61dc5b2ed726" exitCode=0 Jul 20 15:52:30.183046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:30.182698 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" event={"ID":"ec6e20df-8416-4f82-84f0-2f78f572dc43","Type":"ContainerDied","Data":"2b2ba91266c9bb60aa15389bf060fff9a87cc0fcba57826d3f8d61dc5b2ed726"} Jul 20 15:52:30.183046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:30.183029 2585 scope.go:117] "RemoveContainer" containerID="2b2ba91266c9bb60aa15389bf060fff9a87cc0fcba57826d3f8d61dc5b2ed726" Jul 20 15:52:31.187827 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:52:31.187788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lskfk" event={"ID":"ec6e20df-8416-4f82-84f0-2f78f572dc43","Type":"ContainerStarted","Data":"f00618bcf5301b6f2ac0427a94167c664c20a35073e908e2143ae2de1d109e3a"} Jul 20 15:54:14.894048 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.894012 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s"] Jul 20 15:54:14.894515 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.894309 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" containerName="registry" Jul 20 15:54:14.894515 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.894320 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" containerName="registry" Jul 20 15:54:14.894515 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.894373 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="337ea5a3-7c0c-4a58-a33c-a68d44c3353d" containerName="registry" Jul 20 15:54:14.897418 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.897401 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:14.901080 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.901057 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 15:54:14.901648 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.901632 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 15:54:14.901741 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.901635 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fbdjm\"" Jul 20 15:54:14.909802 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:14.909774 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s"] Jul 20 15:54:15.014496 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.014453 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clw2b\" (UniqueName: \"kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.014683 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.014532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.014683 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.014570 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.115942 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.115889 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clw2b\" (UniqueName: \"kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.116069 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.115992 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.116069 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.116036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.116407 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.116387 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.116449 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.116424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.126058 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.126033 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clw2b\" (UniqueName: \"kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.207091 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.207054 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:15.338104 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.338066 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s"] Jul 20 15:54:15.340282 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:54:15.340256 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f75f3d5_69d5_4075_846e_e82ce2de554e.slice/crio-0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e WatchSource:0}: Error finding container 0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e: Status 404 returned error can't find the container with id 0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e Jul 20 15:54:15.571895 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:15.571811 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" event={"ID":"7f75f3d5-69d5-4075-846e-e82ce2de554e","Type":"ContainerStarted","Data":"0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e"} Jul 20 15:54:21.597453 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:21.597412 2585 generic.go:356] "Generic (PLEG): container finished" podID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerID="cb21ff658880d77a882ef724a7a52b619496d8472cb1fec8521ca0819ad34ff1" exitCode=0 Jul 20 15:54:21.597900 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:21.597468 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" event={"ID":"7f75f3d5-69d5-4075-846e-e82ce2de554e","Type":"ContainerDied","Data":"cb21ff658880d77a882ef724a7a52b619496d8472cb1fec8521ca0819ad34ff1"} Jul 20 15:54:24.610920 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:24.610883 2585 generic.go:356] "Generic (PLEG): container finished" podID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerID="66a85c9b13ae01b715e0a1e6fd27d024e7f4a487ab0b3a74591bcc831472b8cd" exitCode=0 Jul 20 15:54:24.611365 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:24.610951 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" event={"ID":"7f75f3d5-69d5-4075-846e-e82ce2de554e","Type":"ContainerDied","Data":"66a85c9b13ae01b715e0a1e6fd27d024e7f4a487ab0b3a74591bcc831472b8cd"} Jul 20 15:54:31.641784 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:31.641748 2585 generic.go:356] "Generic (PLEG): container finished" podID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerID="9d1cc2133f7dd5235bbb38f17f5d45822847c56883662e9712c129c4b764359f" exitCode=0 Jul 20 15:54:31.642197 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:31.641811 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" event={"ID":"7f75f3d5-69d5-4075-846e-e82ce2de554e","Type":"ContainerDied","Data":"9d1cc2133f7dd5235bbb38f17f5d45822847c56883662e9712c129c4b764359f"} Jul 20 15:54:32.773872 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.773844 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:32.844713 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.844683 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clw2b\" (UniqueName: \"kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b\") pod \"7f75f3d5-69d5-4075-846e-e82ce2de554e\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " Jul 20 15:54:32.844882 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.844734 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util\") pod \"7f75f3d5-69d5-4075-846e-e82ce2de554e\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " Jul 20 15:54:32.844882 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.844770 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle\") pod \"7f75f3d5-69d5-4075-846e-e82ce2de554e\" (UID: \"7f75f3d5-69d5-4075-846e-e82ce2de554e\") " Jul 20 15:54:32.845461 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.845430 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle" (OuterVolumeSpecName: "bundle") pod "7f75f3d5-69d5-4075-846e-e82ce2de554e" (UID: "7f75f3d5-69d5-4075-846e-e82ce2de554e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:54:32.846934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.846903 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b" (OuterVolumeSpecName: "kube-api-access-clw2b") pod "7f75f3d5-69d5-4075-846e-e82ce2de554e" (UID: "7f75f3d5-69d5-4075-846e-e82ce2de554e"). InnerVolumeSpecName "kube-api-access-clw2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:54:32.849934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.849911 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util" (OuterVolumeSpecName: "util") pod "7f75f3d5-69d5-4075-846e-e82ce2de554e" (UID: "7f75f3d5-69d5-4075-846e-e82ce2de554e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:54:32.945655 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.945616 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clw2b\" (UniqueName: \"kubernetes.io/projected/7f75f3d5-69d5-4075-846e-e82ce2de554e-kube-api-access-clw2b\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:32.945655 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.945648 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:32.945655 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:32.945658 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f75f3d5-69d5-4075-846e-e82ce2de554e-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:33.651826 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:33.651802 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" Jul 20 15:54:33.651826 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:33.651810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d6s9s" event={"ID":"7f75f3d5-69d5-4075-846e-e82ce2de554e","Type":"ContainerDied","Data":"0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e"} Jul 20 15:54:33.652017 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:33.651853 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ada3f18e93e19d651e1acaccb168b248a5fee22420b040e2d5e6233f5a9fb6e" Jul 20 15:54:38.018827 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.018788 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs"] Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019049 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="pull" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019059 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="pull" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019071 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="extract" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019077 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="extract" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019088 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="util" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019092 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="util" Jul 20 15:54:38.019241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.019178 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f75f3d5-69d5-4075-846e-e82ce2de554e" containerName="extract" Jul 20 15:54:38.022634 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.022616 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.025318 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.025292 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:54:38.025318 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.025303 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 20 15:54:38.025751 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.025735 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-djkkg\"" Jul 20 15:54:38.043712 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.043684 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs"] Jul 20 15:54:38.077302 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.077264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svz9q\" (UniqueName: \"kubernetes.io/projected/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-kube-api-access-svz9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.077483 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.077313 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.178173 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.178120 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svz9q\" (UniqueName: \"kubernetes.io/projected/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-kube-api-access-svz9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.178323 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.178184 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.178525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.178509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.187648 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.187625 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svz9q\" (UniqueName: \"kubernetes.io/projected/9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0-kube-api-access-svz9q\") pod \"cert-manager-operator-controller-manager-55c444bf86-s8hjs\" (UID: \"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.331418 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.331330 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" Jul 20 15:54:38.472868 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.472845 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs"] Jul 20 15:54:38.475764 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:54:38.475739 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b77a6aa_e7c3_448c_9e7e_7bf2306c5bd0.slice/crio-b836b7f49467b59db3b89f40df7fe34dba92663c798936f24c13501fc1f692b9 WatchSource:0}: Error finding container b836b7f49467b59db3b89f40df7fe34dba92663c798936f24c13501fc1f692b9: Status 404 returned error can't find the container with id b836b7f49467b59db3b89f40df7fe34dba92663c798936f24c13501fc1f692b9 Jul 20 15:54:38.670970 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:38.670867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" event={"ID":"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0","Type":"ContainerStarted","Data":"b836b7f49467b59db3b89f40df7fe34dba92663c798936f24c13501fc1f692b9"} Jul 20 15:54:40.680168 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:40.680131 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" event={"ID":"9b77a6aa-e7c3-448c-9e7e-7bf2306c5bd0","Type":"ContainerStarted","Data":"ff0790cc5998d614bc933b232e4c0029df2c396f65595c691064a14dfc228bef"} Jul 20 15:54:42.237648 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.237591 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s8hjs" podStartSLOduration=3.836408488 podStartE2EDuration="5.237569485s" totalImagesPullingTime="1.401160997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:54:40.735086671 +0000 UTC m=+257.681542325" watchObservedRunningTime="2026-07-20 15:54:42.237569485 +0000 UTC m=+259.184025139" Jul 20 15:54:42.238690 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.238670 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj"] Jul 20 15:54:42.242199 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.242180 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.245067 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.245042 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 15:54:42.245205 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.245078 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fbdjm\"" Jul 20 15:54:42.246223 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.246206 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 15:54:42.251520 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.251500 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj"] Jul 20 15:54:42.307792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.307756 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpwcq\" (UniqueName: \"kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.307967 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.307810 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.307967 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.307873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.408311 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.408277 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.408493 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.408337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.408493 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.408477 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpwcq\" (UniqueName: \"kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.408670 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.408655 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.408738 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.408718 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.422970 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.422936 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpwcq\" (UniqueName: \"kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.552831 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.552747 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:42.595168 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.595118 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w5qpk"] Jul 20 15:54:42.599443 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.599420 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.602280 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.602241 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 15:54:42.602446 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.602308 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7qcjj\"" Jul 20 15:54:42.602596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.602579 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 15:54:42.613597 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.613564 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w5qpk"] Jul 20 15:54:42.699278 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.699252 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj"] Jul 20 15:54:42.701079 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:54:42.701057 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8a0af6_3728_4555_8bcb_2c874d683283.slice/crio-0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4 WatchSource:0}: Error finding container 0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4: Status 404 returned error can't find the container with id 0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4 Jul 20 15:54:42.709976 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.709954 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7b5\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-kube-api-access-ln7b5\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.710047 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.710014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.810430 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.810358 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7b5\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-kube-api-access-ln7b5\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.810430 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.810403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.819308 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.819284 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.819440 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.819373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7b5\" (UniqueName: \"kubernetes.io/projected/67ad8a60-4684-4077-afe5-e9d535834f25-kube-api-access-ln7b5\") pod \"cert-manager-webhook-6486ffd997-w5qpk\" (UID: \"67ad8a60-4684-4077-afe5-e9d535834f25\") " pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:42.925337 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:42.925302 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:43.055283 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:43.055255 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-w5qpk"] Jul 20 15:54:43.057728 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:54:43.057701 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67ad8a60_4684_4077_afe5_e9d535834f25.slice/crio-f4c38a6cc778ec58df4eb3377eb2d4541b60865f5120e6860860f262fb57c0e7 WatchSource:0}: Error finding container f4c38a6cc778ec58df4eb3377eb2d4541b60865f5120e6860860f262fb57c0e7: Status 404 returned error can't find the container with id f4c38a6cc778ec58df4eb3377eb2d4541b60865f5120e6860860f262fb57c0e7 Jul 20 15:54:43.694594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:43.694456 2585 generic.go:356] "Generic (PLEG): container finished" podID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerID="9700d92cee4f14d57af57f9835fa8a237516fc9196fee1180d465650f21a1654" exitCode=0 Jul 20 15:54:43.694594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:43.694518 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" event={"ID":"ce8a0af6-3728-4555-8bcb-2c874d683283","Type":"ContainerDied","Data":"9700d92cee4f14d57af57f9835fa8a237516fc9196fee1180d465650f21a1654"} Jul 20 15:54:43.694594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:43.694592 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" event={"ID":"ce8a0af6-3728-4555-8bcb-2c874d683283","Type":"ContainerStarted","Data":"0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4"} Jul 20 15:54:43.696052 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:43.696024 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" event={"ID":"67ad8a60-4684-4077-afe5-e9d535834f25","Type":"ContainerStarted","Data":"f4c38a6cc778ec58df4eb3377eb2d4541b60865f5120e6860860f262fb57c0e7"} Jul 20 15:54:44.219668 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.219634 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lm56l"] Jul 20 15:54:44.222877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.222855 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.225448 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.225426 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r6lvf\"" Jul 20 15:54:44.230315 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.230290 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lm56l"] Jul 20 15:54:44.320448 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.320417 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.320623 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.320467 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvx9d\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-kube-api-access-nvx9d\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.421553 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.421516 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.421771 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.421578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvx9d\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-kube-api-access-nvx9d\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.435572 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.435509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvx9d\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-kube-api-access-nvx9d\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.435751 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.435722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6ad86a7-b41a-42b7-bc55-ddbc88a82623-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-lm56l\" (UID: \"b6ad86a7-b41a-42b7-bc55-ddbc88a82623\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.534538 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.534438 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" Jul 20 15:54:44.722073 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:44.722041 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-lm56l"] Jul 20 15:54:45.649424 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:54:45.649387 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6ad86a7_b41a_42b7_bc55_ddbc88a82623.slice/crio-b8ff0b430403db751a496ffc628f236e63dd87f60c73d2c9f0d95f4902340a99 WatchSource:0}: Error finding container b8ff0b430403db751a496ffc628f236e63dd87f60c73d2c9f0d95f4902340a99: Status 404 returned error can't find the container with id b8ff0b430403db751a496ffc628f236e63dd87f60c73d2c9f0d95f4902340a99 Jul 20 15:54:45.709751 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:45.709704 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" event={"ID":"b6ad86a7-b41a-42b7-bc55-ddbc88a82623","Type":"ContainerStarted","Data":"b8ff0b430403db751a496ffc628f236e63dd87f60c73d2c9f0d95f4902340a99"} Jul 20 15:54:46.716111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.716068 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" event={"ID":"67ad8a60-4684-4077-afe5-e9d535834f25","Type":"ContainerStarted","Data":"afe6283b44afe41708e1326802bf9d01b6849f7d87610d51af47109f36ece108"} Jul 20 15:54:46.716575 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.716188 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:54:46.717767 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.717739 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" event={"ID":"b6ad86a7-b41a-42b7-bc55-ddbc88a82623","Type":"ContainerStarted","Data":"c7e394fc3b8f7219789955b0d516e64ad2bec44173761588b85013f651fe5a17"} Jul 20 15:54:46.719509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.719489 2585 generic.go:356] "Generic (PLEG): container finished" podID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerID="2e6a98d41ae0dbcaad86d028028aa556889ccb3bcc7b3b8e6bfb6dcabafa412f" exitCode=0 Jul 20 15:54:46.719603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.719518 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" event={"ID":"ce8a0af6-3728-4555-8bcb-2c874d683283","Type":"ContainerDied","Data":"2e6a98d41ae0dbcaad86d028028aa556889ccb3bcc7b3b8e6bfb6dcabafa412f"} Jul 20 15:54:46.752604 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.752557 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" podStartSLOduration=1.414958425 podStartE2EDuration="4.752540496s" totalImagesPullingTime="3.337582071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:54:46.752243967 +0000 UTC m=+263.698699625" watchObservedRunningTime="2026-07-20 15:54:46.752540496 +0000 UTC m=+263.698996151" Jul 20 15:54:46.780069 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:46.780014 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-lm56l" podStartSLOduration=1.971078292 podStartE2EDuration="2.779991768s" totalImagesPullingTime="808.913476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:54:46.777862124 +0000 UTC m=+263.724317801" watchObservedRunningTime="2026-07-20 15:54:46.779991768 +0000 UTC m=+263.726447425" Jul 20 15:54:47.725289 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:47.725252 2585 generic.go:356] "Generic (PLEG): container finished" podID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerID="bb954757dd7d1f080db37e37daab701a4801d4bb09e41c1e07184daa0a225aca" exitCode=0 Jul 20 15:54:47.725666 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:47.725332 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" event={"ID":"ce8a0af6-3728-4555-8bcb-2c874d683283","Type":"ContainerDied","Data":"bb954757dd7d1f080db37e37daab701a4801d4bb09e41c1e07184daa0a225aca"} Jul 20 15:54:48.855529 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.855503 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:48.958196 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.958140 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle\") pod \"ce8a0af6-3728-4555-8bcb-2c874d683283\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " Jul 20 15:54:48.958196 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.958201 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util\") pod \"ce8a0af6-3728-4555-8bcb-2c874d683283\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " Jul 20 15:54:48.958453 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.958220 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpwcq\" (UniqueName: \"kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq\") pod \"ce8a0af6-3728-4555-8bcb-2c874d683283\" (UID: \"ce8a0af6-3728-4555-8bcb-2c874d683283\") " Jul 20 15:54:48.958641 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.958612 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle" (OuterVolumeSpecName: "bundle") pod "ce8a0af6-3728-4555-8bcb-2c874d683283" (UID: "ce8a0af6-3728-4555-8bcb-2c874d683283"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:54:48.960390 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.960364 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq" (OuterVolumeSpecName: "kube-api-access-kpwcq") pod "ce8a0af6-3728-4555-8bcb-2c874d683283" (UID: "ce8a0af6-3728-4555-8bcb-2c874d683283"). InnerVolumeSpecName "kube-api-access-kpwcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:54:48.962804 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:48.962781 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util" (OuterVolumeSpecName: "util") pod "ce8a0af6-3728-4555-8bcb-2c874d683283" (UID: "ce8a0af6-3728-4555-8bcb-2c874d683283"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:54:49.059032 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.058946 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpwcq\" (UniqueName: \"kubernetes.io/projected/ce8a0af6-3728-4555-8bcb-2c874d683283-kube-api-access-kpwcq\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:49.059032 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.058975 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:49.059032 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.058984 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce8a0af6-3728-4555-8bcb-2c874d683283-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:54:49.740076 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.740040 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" event={"ID":"ce8a0af6-3728-4555-8bcb-2c874d683283","Type":"ContainerDied","Data":"0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4"} Jul 20 15:54:49.740076 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.740074 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx7hdj" Jul 20 15:54:49.740275 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:49.740122 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fc43ad9802281f74f527c880841f8b9617013d13f27a55c22b66a38e0377be4" Jul 20 15:54:52.727794 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:54:52.727762 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-w5qpk" Jul 20 15:55:01.665227 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665190 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf"] Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665463 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="pull" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665475 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="pull" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665492 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="extract" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665497 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="extract" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665508 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="util" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665513 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="util" Jul 20 15:55:01.665595 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.665562 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce8a0af6-3728-4555-8bcb-2c874d683283" containerName="extract" Jul 20 15:55:01.703574 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.703535 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf"] Jul 20 15:55:01.703723 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.703645 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.707293 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.707272 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 20 15:55:01.707819 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.707801 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 20 15:55:01.707933 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.707891 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fbdjm\"" Jul 20 15:55:01.760174 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.760128 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.760341 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.760184 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.760341 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.760300 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfd55\" (UniqueName: \"kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.861420 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.861377 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.861420 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.861420 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.861676 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.861473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfd55\" (UniqueName: \"kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.861852 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.861831 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.861915 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.861844 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:01.870045 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:01.870018 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfd55\" (UniqueName: \"kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:02.013305 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:02.013265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:02.160562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:02.160533 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf"] Jul 20 15:55:02.162334 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:55:02.162310 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d3ea12_6c4f_475a_9f27_f1ab3e4b01ff.slice/crio-faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb WatchSource:0}: Error finding container faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb: Status 404 returned error can't find the container with id faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb Jul 20 15:55:02.797700 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:02.797665 2585 generic.go:356] "Generic (PLEG): container finished" podID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerID="c0b89f5956595c4b939ba836d59e6a3de56d875c77accb3094cd850110e1668a" exitCode=0 Jul 20 15:55:02.798208 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:02.797755 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" event={"ID":"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff","Type":"ContainerDied","Data":"c0b89f5956595c4b939ba836d59e6a3de56d875c77accb3094cd850110e1668a"} Jul 20 15:55:02.798208 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:02.797804 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" event={"ID":"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff","Type":"ContainerStarted","Data":"faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb"} Jul 20 15:55:03.803835 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:03.803801 2585 generic.go:356] "Generic (PLEG): container finished" podID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerID="286371bf19fa3a1e31739d5d660e55b1ca154874f653c5c98382748e034442fe" exitCode=0 Jul 20 15:55:03.804265 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:03.803843 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" event={"ID":"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff","Type":"ContainerDied","Data":"286371bf19fa3a1e31739d5d660e55b1ca154874f653c5c98382748e034442fe"} Jul 20 15:55:04.810599 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:04.810563 2585 generic.go:356] "Generic (PLEG): container finished" podID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerID="f6569ab30d81a1b279faf880b14d768bd7d293d275337f667e3b9fb80807d514" exitCode=0 Jul 20 15:55:04.810986 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:04.810607 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" event={"ID":"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff","Type":"ContainerDied","Data":"f6569ab30d81a1b279faf880b14d768bd7d293d275337f667e3b9fb80807d514"} Jul 20 15:55:05.946231 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.946206 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:05.994959 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.994929 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle\") pod \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " Jul 20 15:55:05.995122 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.994983 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfd55\" (UniqueName: \"kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55\") pod \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " Jul 20 15:55:05.995122 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.995011 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util\") pod \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\" (UID: \"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff\") " Jul 20 15:55:05.995768 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.995731 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle" (OuterVolumeSpecName: "bundle") pod "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" (UID: "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:55:05.997150 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:05.997130 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55" (OuterVolumeSpecName: "kube-api-access-mfd55") pod "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" (UID: "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff"). InnerVolumeSpecName "kube-api-access-mfd55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:55:06.001108 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.001083 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util" (OuterVolumeSpecName: "util") pod "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" (UID: "80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:55:06.095915 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.095826 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:55:06.095915 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.095859 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfd55\" (UniqueName: \"kubernetes.io/projected/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-kube-api-access-mfd55\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:55:06.095915 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.095870 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:55:06.821088 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.821056 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" event={"ID":"80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff","Type":"ContainerDied","Data":"faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb"} Jul 20 15:55:06.821319 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.821113 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa9799faba35012084c7bf5a77fa4235632aa283ac9a533ce33ebecb12777cb" Jul 20 15:55:06.821319 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:06.821071 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7spmf" Jul 20 15:55:19.512505 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512474 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65"] Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512792 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="extract" Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512806 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="extract" Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512821 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="pull" Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512828 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="pull" Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512836 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="util" Jul 20 15:55:19.512879 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512841 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="util" Jul 20 15:55:19.513052 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.512901 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d3ea12-6c4f-475a-9f27-f1ab3e4b01ff" containerName="extract" Jul 20 15:55:19.514900 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.514884 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.518229 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.518205 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 20 15:55:19.518364 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.518314 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 20 15:55:19.518364 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.518320 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 15:55:19.519201 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.519184 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ft7hk\"" Jul 20 15:55:19.519310 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.519189 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 15:55:19.540171 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.540138 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65"] Jul 20 15:55:19.603892 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.603860 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwbq6\" (UniqueName: \"kubernetes.io/projected/b47a53da-299a-477a-aa31-7abe3d07d344-kube-api-access-xwbq6\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.604044 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.603917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.604044 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.603960 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-manifests\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.604044 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.603983 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-tmp\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.604210 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.604055 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.704681 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.704644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-tmp\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.704855 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.704699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.704855 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.704723 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwbq6\" (UniqueName: \"kubernetes.io/projected/b47a53da-299a-477a-aa31-7abe3d07d344-kube-api-access-xwbq6\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.704855 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.704764 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.704855 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.704792 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-manifests\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.705203 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.705176 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-manifests\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.707121 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.707092 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47a53da-299a-477a-aa31-7abe3d07d344-tmp\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.707251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.707234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.707296 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.707260 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47a53da-299a-477a-aa31-7abe3d07d344-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.724262 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.724232 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwbq6\" (UniqueName: \"kubernetes.io/projected/b47a53da-299a-477a-aa31-7abe3d07d344-kube-api-access-xwbq6\") pod \"opendatahub-operator-controller-manager-5b76897bc6-h4c65\" (UID: \"b47a53da-299a-477a-aa31-7abe3d07d344\") " pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.825531 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.825452 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:19.961017 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:19.960992 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65"] Jul 20 15:55:19.963389 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:55:19.963359 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47a53da_299a_477a_aa31_7abe3d07d344.slice/crio-638c62940b177c4312ef5ad66153f79c51e3b134d5ee6d14816031c9a928ed29 WatchSource:0}: Error finding container 638c62940b177c4312ef5ad66153f79c51e3b134d5ee6d14816031c9a928ed29: Status 404 returned error can't find the container with id 638c62940b177c4312ef5ad66153f79c51e3b134d5ee6d14816031c9a928ed29 Jul 20 15:55:20.884788 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:20.884745 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" event={"ID":"b47a53da-299a-477a-aa31-7abe3d07d344","Type":"ContainerStarted","Data":"638c62940b177c4312ef5ad66153f79c51e3b134d5ee6d14816031c9a928ed29"} Jul 20 15:55:22.897074 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:22.897041 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" event={"ID":"b47a53da-299a-477a-aa31-7abe3d07d344","Type":"ContainerStarted","Data":"dffe36e4f6dedafb66892120d4914b33a51f429dbeb12556ef5a4046ce1470c4"} Jul 20 15:55:23.444589 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:23.444560 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 15:55:23.447843 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:23.447816 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 15:55:23.451296 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:23.451276 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:55:23.454461 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:23.454441 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 15:55:23.457744 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:23.457725 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 15:55:24.907264 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:24.907226 2585 generic.go:356] "Generic (PLEG): container finished" podID="b47a53da-299a-477a-aa31-7abe3d07d344" containerID="dffe36e4f6dedafb66892120d4914b33a51f429dbeb12556ef5a4046ce1470c4" exitCode=0 Jul 20 15:55:24.907264 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:24.907266 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" event={"ID":"b47a53da-299a-477a-aa31-7abe3d07d344","Type":"ContainerDied","Data":"dffe36e4f6dedafb66892120d4914b33a51f429dbeb12556ef5a4046ce1470c4"} Jul 20 15:55:24.907829 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:24.907813 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 15:55:25.913488 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:25.913451 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" event={"ID":"b47a53da-299a-477a-aa31-7abe3d07d344","Type":"ContainerStarted","Data":"109f5dd5c5fe7510efb89fd465d8d39ef4a0290c781a4a63b070c35775672a89"} Jul 20 15:55:25.913862 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:25.913661 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:25.972221 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:25.972147 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" podStartSLOduration=2.636596863 podStartE2EDuration="6.972129606s" totalImagesPullingTime="3.186628279s" totalInitContainerRuntime="1.148904464s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:55:25.971348426 +0000 UTC m=+302.917804081" watchObservedRunningTime="2026-07-20 15:55:25.972129606 +0000 UTC m=+302.918585261" Jul 20 15:55:36.920510 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:36.920480 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b76897bc6-h4c65" Jul 20 15:55:39.787173 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.787099 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5ntpd"] Jul 20 15:55:39.795979 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.795953 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:39.800502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.800478 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 20 15:55:39.800502 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.800486 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-n9bjz\"" Jul 20 15:55:39.812150 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.812125 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5ntpd"] Jul 20 15:55:39.871477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.871445 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:39.871656 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.871528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6klsk\" (UniqueName: \"kubernetes.io/projected/156913d7-647c-4132-aa8b-4828c9333d21-kube-api-access-6klsk\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:39.971867 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.971834 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:39.972031 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.971912 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6klsk\" (UniqueName: \"kubernetes.io/projected/156913d7-647c-4132-aa8b-4828c9333d21-kube-api-access-6klsk\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:39.972031 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:55:39.971965 2585 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 20 15:55:39.972098 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:55:39.972064 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert podName:156913d7-647c-4132-aa8b-4828c9333d21 nodeName:}" failed. No retries permitted until 2026-07-20 15:55:40.472042336 +0000 UTC m=+317.418497972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert") pod "odh-model-controller-7998c67dc4-5ntpd" (UID: "156913d7-647c-4132-aa8b-4828c9333d21") : secret "odh-model-controller-webhook-cert" not found Jul 20 15:55:39.991700 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:39.991671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6klsk\" (UniqueName: \"kubernetes.io/projected/156913d7-647c-4132-aa8b-4828c9333d21-kube-api-access-6klsk\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:40.476565 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.476530 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:40.478907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.478886 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/156913d7-647c-4132-aa8b-4828c9333d21-cert\") pod \"odh-model-controller-7998c67dc4-5ntpd\" (UID: \"156913d7-647c-4132-aa8b-4828c9333d21\") " pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:40.705749 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.705712 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:40.762892 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.762858 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qcn6"] Jul 20 15:55:40.765725 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.765702 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:40.769107 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.768878 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 20 15:55:40.784299 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.784275 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qcn6"] Jul 20 15:55:40.847459 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.847430 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5ntpd"] Jul 20 15:55:40.849470 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:55:40.849448 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156913d7_647c_4132_aa8b_4828c9333d21.slice/crio-dc307960aab34b9a364aa76173b5fb4105d1f6df24fb364edbf30c5007c91639 WatchSource:0}: Error finding container dc307960aab34b9a364aa76173b5fb4105d1f6df24fb364edbf30c5007c91639: Status 404 returned error can't find the container with id dc307960aab34b9a364aa76173b5fb4105d1f6df24fb364edbf30c5007c91639 Jul 20 15:55:40.879239 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.879210 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:40.879386 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.879275 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zfnl\" (UniqueName: \"kubernetes.io/projected/e58ea023-1319-46f7-aec7-487f17308e0b-kube-api-access-4zfnl\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:40.978690 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.978656 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" event={"ID":"156913d7-647c-4132-aa8b-4828c9333d21","Type":"ContainerStarted","Data":"dc307960aab34b9a364aa76173b5fb4105d1f6df24fb364edbf30c5007c91639"} Jul 20 15:55:40.980040 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.980016 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zfnl\" (UniqueName: \"kubernetes.io/projected/e58ea023-1319-46f7-aec7-487f17308e0b-kube-api-access-4zfnl\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:40.980146 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.980087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:40.980259 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:55:40.980243 2585 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 20 15:55:40.980338 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:55:40.980327 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs podName:e58ea023-1319-46f7-aec7-487f17308e0b nodeName:}" failed. No retries permitted until 2026-07-20 15:55:41.480303993 +0000 UTC m=+318.426759642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs") pod "model-serving-api-54d89bd5fc-5qcn6" (UID: "e58ea023-1319-46f7-aec7-487f17308e0b") : secret "model-serving-api-tls" not found Jul 20 15:55:40.990648 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:40.990628 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zfnl\" (UniqueName: \"kubernetes.io/projected/e58ea023-1319-46f7-aec7-487f17308e0b-kube-api-access-4zfnl\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:41.484973 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:41.484936 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:41.487367 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:41.487341 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e58ea023-1319-46f7-aec7-487f17308e0b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5qcn6\" (UID: \"e58ea023-1319-46f7-aec7-487f17308e0b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:41.679379 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:41.679338 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:41.847603 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:41.847378 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5qcn6"] Jul 20 15:55:41.985492 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:41.985455 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" event={"ID":"e58ea023-1319-46f7-aec7-487f17308e0b","Type":"ContainerStarted","Data":"83e49541ef68d0a65be7bd65a10f391658017a746c074f6d7ab3358f945e9f9f"} Jul 20 15:55:43.996490 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:43.996454 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" event={"ID":"156913d7-647c-4132-aa8b-4828c9333d21","Type":"ContainerStarted","Data":"abf939769945e70fa761e84ca3d3342c021e4bc41fc16521a09b399284335bf0"} Jul 20 15:55:43.996972 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:43.996634 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:45.007455 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:45.007342 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" event={"ID":"e58ea023-1319-46f7-aec7-487f17308e0b","Type":"ContainerStarted","Data":"86e525066202378ef6126cd04af7cf90984a157cf1b5d661dc63ba9c4f6fd97d"} Jul 20 15:55:45.007455 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:45.007445 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:45.040130 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:45.040074 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" podStartSLOduration=3.301380941 podStartE2EDuration="6.040057377s" totalImagesPullingTime="2.738676436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:55:44.030507086 +0000 UTC m=+320.976962740" watchObservedRunningTime="2026-07-20 15:55:45.040057377 +0000 UTC m=+321.986513051" Jul 20 15:55:45.040337 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:45.040174 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" podStartSLOduration=2.14200257 podStartE2EDuration="5.040168057s" totalImagesPullingTime="2.898165487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:55:45.038671251 +0000 UTC m=+321.985126906" watchObservedRunningTime="2026-07-20 15:55:45.040168057 +0000 UTC m=+321.986623702" Jul 20 15:55:47.628837 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.628804 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k"] Jul 20 15:55:47.631681 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.631663 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.636779 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.636754 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 20 15:55:47.636908 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.636786 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 20 15:55:47.637466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.637438 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 20 15:55:47.637583 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.637504 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 20 15:55:47.637583 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.637538 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 20 15:55:47.637583 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.637567 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pfx5x\"" Jul 20 15:55:47.665596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.665561 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k"] Jul 20 15:55:47.744450 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.744405 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f17a532-f24e-4e18-93e3-321d6e178518-manager-config\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.744617 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.744494 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.744617 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.744552 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-metrics-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.744617 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.744587 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72j2n\" (UniqueName: \"kubernetes.io/projected/2f17a532-f24e-4e18-93e3-321d6e178518-kube-api-access-72j2n\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.845780 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.845740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.845977 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.845789 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-metrics-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.845977 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.845810 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72j2n\" (UniqueName: \"kubernetes.io/projected/2f17a532-f24e-4e18-93e3-321d6e178518-kube-api-access-72j2n\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.845977 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.845844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f17a532-f24e-4e18-93e3-321d6e178518-manager-config\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.846499 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.846471 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2f17a532-f24e-4e18-93e3-321d6e178518-manager-config\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.848309 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.848287 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.848478 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.848455 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f17a532-f24e-4e18-93e3-321d6e178518-metrics-cert\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.873238 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.873213 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72j2n\" (UniqueName: \"kubernetes.io/projected/2f17a532-f24e-4e18-93e3-321d6e178518-kube-api-access-72j2n\") pod \"lws-controller-manager-8c9c5dcb7-mn95k\" (UID: \"2f17a532-f24e-4e18-93e3-321d6e178518\") " pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:47.941317 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:47.941283 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:48.098809 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:48.098768 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k"] Jul 20 15:55:48.130464 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:55:48.130431 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f17a532_f24e_4e18_93e3_321d6e178518.slice/crio-98b6185149b25f1b93439c0ecff5bf63087d83316eada3060c1e388a7276e571 WatchSource:0}: Error finding container 98b6185149b25f1b93439c0ecff5bf63087d83316eada3060c1e388a7276e571: Status 404 returned error can't find the container with id 98b6185149b25f1b93439c0ecff5bf63087d83316eada3060c1e388a7276e571 Jul 20 15:55:49.027352 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:49.027314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" event={"ID":"2f17a532-f24e-4e18-93e3-321d6e178518","Type":"ContainerStarted","Data":"98b6185149b25f1b93439c0ecff5bf63087d83316eada3060c1e388a7276e571"} Jul 20 15:55:51.038251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:51.038145 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" event={"ID":"2f17a532-f24e-4e18-93e3-321d6e178518","Type":"ContainerStarted","Data":"236257223cc8413c1fa43f1724e2272108be68c22abae7cdf44dc8f0ac5d6cd5"} Jul 20 15:55:51.038251 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:51.038221 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:55:51.069405 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:51.069352 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" podStartSLOduration=1.5098430330000001 podStartE2EDuration="4.069339186s" totalImagesPullingTime="2.559496153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:55:51.067820626 +0000 UTC m=+328.014276281" watchObservedRunningTime="2026-07-20 15:55:51.069339186 +0000 UTC m=+328.015794840" Jul 20 15:55:55.010087 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:55.010057 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5ntpd" Jul 20 15:55:56.017525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:56.017497 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5qcn6" Jul 20 15:55:59.372081 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.372047 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw"] Jul 20 15:55:59.375540 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.375524 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.380247 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.380224 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gs48g\"" Jul 20 15:55:59.380355 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.380299 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 20 15:55:59.398364 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.398333 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw"] Jul 20 15:55:59.443699 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443663 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.443877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443703 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.443877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l42jb\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-kube-api-access-l42jb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.443877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443755 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.443877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443836 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.443877 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443860 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.444105 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443885 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.444105 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.443954 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.444105 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.444001 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.544797 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.544797 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544796 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544839 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544893 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.544974 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545006 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l42jb\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-kube-api-access-l42jb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545046 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545033 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545447 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545260 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545447 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545263 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545596 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545565 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545769 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545583 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.545907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.545865 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.547626 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.547603 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.547711 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.547629 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.555960 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.555937 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.557229 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.557210 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l42jb\" (UniqueName: \"kubernetes.io/projected/fe3a02a7-67b5-4af9-9427-c5eba5feb50d-kube-api-access-l42jb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gq5vw\" (UID: \"fe3a02a7-67b5-4af9-9427-c5eba5feb50d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.686139 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.686108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:55:59.828045 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:55:59.828015 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw"] Jul 20 15:55:59.829636 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:55:59.829610 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3a02a7_67b5_4af9_9427_c5eba5feb50d.slice/crio-9ef423f575ffed37ecf38a151514a8c6a77b39900d65463120a141bba7192096 WatchSource:0}: Error finding container 9ef423f575ffed37ecf38a151514a8c6a77b39900d65463120a141bba7192096: Status 404 returned error can't find the container with id 9ef423f575ffed37ecf38a151514a8c6a77b39900d65463120a141bba7192096 Jul 20 15:56:00.082101 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:00.082015 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" event={"ID":"fe3a02a7-67b5-4af9-9427-c5eba5feb50d","Type":"ContainerStarted","Data":"9ef423f575ffed37ecf38a151514a8c6a77b39900d65463120a141bba7192096"} Jul 20 15:56:02.045690 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:02.045656 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8c9c5dcb7-mn95k" Jul 20 15:56:02.298461 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:02.298412 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:56:02.298570 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:02.298502 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:56:02.298570 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:02.298533 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:56:03.102932 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:03.102894 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" event={"ID":"fe3a02a7-67b5-4af9-9427-c5eba5feb50d","Type":"ContainerStarted","Data":"22bae37e0769b3c4e73d429458ffd3eb507797273381852a7241ecd708ae6d4f"} Jul 20 15:56:03.125439 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:03.125387 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" podStartSLOduration=1.658875311 podStartE2EDuration="4.125370695s" totalImagesPullingTime="2.466495384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:56:03.123839678 +0000 UTC m=+340.070295333" watchObservedRunningTime="2026-07-20 15:56:03.125370695 +0000 UTC m=+340.071826370" Jul 20 15:56:03.686805 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:03.686760 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:56:03.691435 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:03.691411 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:56:04.108183 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:04.108082 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:56:04.109111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:04.109092 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gq5vw" Jul 20 15:56:40.600029 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.599945 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:40.612208 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.612178 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:40.615405 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.614862 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 20 15:56:40.615689 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.615663 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:40.616232 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.616213 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 20 15:56:40.616327 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.616217 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ltv4k\"" Jul 20 15:56:40.695475 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.695423 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf5b9\" (UniqueName: \"kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9\") pod \"kuadrant-operator-catalog-bptnf\" (UID: \"7fb20efd-3c73-4036-bdf5-1f587d5c727d\") " pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:40.796026 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.795975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf5b9\" (UniqueName: \"kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9\") pod \"kuadrant-operator-catalog-bptnf\" (UID: \"7fb20efd-3c73-4036-bdf5-1f587d5c727d\") " pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:40.808958 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.808926 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf5b9\" (UniqueName: \"kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9\") pod \"kuadrant-operator-catalog-bptnf\" (UID: \"7fb20efd-3c73-4036-bdf5-1f587d5c727d\") " pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:40.925178 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.925068 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:40.954572 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:40.954543 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:41.065832 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.065804 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:41.068428 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:41.068401 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb20efd_3c73_4036_bdf5_1f587d5c727d.slice/crio-792bf225787c00161b2e87d6625679623f5a282921a309fa534ffee83289aa81 WatchSource:0}: Error finding container 792bf225787c00161b2e87d6625679623f5a282921a309fa534ffee83289aa81: Status 404 returned error can't find the container with id 792bf225787c00161b2e87d6625679623f5a282921a309fa534ffee83289aa81 Jul 20 15:56:41.156689 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.156650 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf2dg"] Jul 20 15:56:41.161674 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.161655 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:41.170375 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.170350 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf2dg"] Jul 20 15:56:41.284990 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.284956 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" event={"ID":"7fb20efd-3c73-4036-bdf5-1f587d5c727d","Type":"ContainerStarted","Data":"792bf225787c00161b2e87d6625679623f5a282921a309fa534ffee83289aa81"} Jul 20 15:56:41.301092 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.301062 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvww8\" (UniqueName: \"kubernetes.io/projected/bfa217b9-ef60-44f5-ae91-31f103e973cb-kube-api-access-xvww8\") pod \"kuadrant-operator-catalog-kf2dg\" (UID: \"bfa217b9-ef60-44f5-ae91-31f103e973cb\") " pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:41.402378 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.402337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvww8\" (UniqueName: \"kubernetes.io/projected/bfa217b9-ef60-44f5-ae91-31f103e973cb-kube-api-access-xvww8\") pod \"kuadrant-operator-catalog-kf2dg\" (UID: \"bfa217b9-ef60-44f5-ae91-31f103e973cb\") " pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:41.412229 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.412193 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvww8\" (UniqueName: \"kubernetes.io/projected/bfa217b9-ef60-44f5-ae91-31f103e973cb-kube-api-access-xvww8\") pod \"kuadrant-operator-catalog-kf2dg\" (UID: \"bfa217b9-ef60-44f5-ae91-31f103e973cb\") " pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:41.472016 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.471975 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:41.617639 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:41.617616 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kf2dg"] Jul 20 15:56:41.619870 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:41.619840 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa217b9_ef60_44f5_ae91_31f103e973cb.slice/crio-19d52caf005e2ca064faf18b267d18cecd04d6a8341ca7553e2590c007937443 WatchSource:0}: Error finding container 19d52caf005e2ca064faf18b267d18cecd04d6a8341ca7553e2590c007937443: Status 404 returned error can't find the container with id 19d52caf005e2ca064faf18b267d18cecd04d6a8341ca7553e2590c007937443 Jul 20 15:56:42.292100 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:42.292058 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" event={"ID":"bfa217b9-ef60-44f5-ae91-31f103e973cb","Type":"ContainerStarted","Data":"19d52caf005e2ca064faf18b267d18cecd04d6a8341ca7553e2590c007937443"} Jul 20 15:56:44.303490 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.303454 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" event={"ID":"7fb20efd-3c73-4036-bdf5-1f587d5c727d","Type":"ContainerStarted","Data":"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68"} Jul 20 15:56:44.303959 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.303539 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" podUID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" containerName="registry-server" containerID="cri-o://fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68" gracePeriod=2 Jul 20 15:56:44.305043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.305014 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" event={"ID":"bfa217b9-ef60-44f5-ae91-31f103e973cb","Type":"ContainerStarted","Data":"7403fad30c03a3b8df06a78afeb952d9432f6e16707533903d2acc99fed0f910"} Jul 20 15:56:44.322013 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.321967 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" podStartSLOduration=1.781361049 podStartE2EDuration="4.321950672s" totalImagesPullingTime="2.540589623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:56:44.319431687 +0000 UTC m=+381.265887343" watchObservedRunningTime="2026-07-20 15:56:44.321950672 +0000 UTC m=+381.268406327" Jul 20 15:56:44.552117 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.552091 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:44.573567 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.573463 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" podStartSLOduration=1.581975703 podStartE2EDuration="3.57344208s" totalImagesPullingTime="1.991466377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:56:44.334397472 +0000 UTC m=+381.280853128" watchObservedRunningTime="2026-07-20 15:56:44.57344208 +0000 UTC m=+381.519897736" Jul 20 15:56:44.631957 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.631918 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf5b9\" (UniqueName: \"kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9\") pod \"7fb20efd-3c73-4036-bdf5-1f587d5c727d\" (UID: \"7fb20efd-3c73-4036-bdf5-1f587d5c727d\") " Jul 20 15:56:44.634076 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.634045 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9" (OuterVolumeSpecName: "kube-api-access-rf5b9") pod "7fb20efd-3c73-4036-bdf5-1f587d5c727d" (UID: "7fb20efd-3c73-4036-bdf5-1f587d5c727d"). InnerVolumeSpecName "kube-api-access-rf5b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:56:44.733142 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:44.733106 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf5b9\" (UniqueName: \"kubernetes.io/projected/7fb20efd-3c73-4036-bdf5-1f587d5c727d-kube-api-access-rf5b9\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:56:45.311216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.311182 2585 generic.go:356] "Generic (PLEG): container finished" podID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" containerID="fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68" exitCode=0 Jul 20 15:56:45.311672 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.311224 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" Jul 20 15:56:45.311672 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.311272 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" event={"ID":"7fb20efd-3c73-4036-bdf5-1f587d5c727d","Type":"ContainerDied","Data":"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68"} Jul 20 15:56:45.311672 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.311318 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bptnf" event={"ID":"7fb20efd-3c73-4036-bdf5-1f587d5c727d","Type":"ContainerDied","Data":"792bf225787c00161b2e87d6625679623f5a282921a309fa534ffee83289aa81"} Jul 20 15:56:45.311672 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.311338 2585 scope.go:117] "RemoveContainer" containerID="fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68" Jul 20 15:56:45.321490 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.321476 2585 scope.go:117] "RemoveContainer" containerID="fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68" Jul 20 15:56:45.321737 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:56:45.321716 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68\": container with ID starting with fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68 not found: ID does not exist" containerID="fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68" Jul 20 15:56:45.321801 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.321750 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68"} err="failed to get container status \"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68\": rpc error: code = NotFound desc = could not find container \"fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68\": container with ID starting with fa781531ee72e9be0db93375bd0fd1f114bf82d1763991f151d7f309b4a15b68 not found: ID does not exist" Jul 20 15:56:45.334282 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.334263 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:45.338998 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.338980 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bptnf"] Jul 20 15:56:45.540062 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:45.540028 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" path="/var/lib/kubelet/pods/7fb20efd-3c73-4036-bdf5-1f587d5c727d/volumes" Jul 20 15:56:51.472435 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:51.472401 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:51.472859 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:51.472473 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:51.494882 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:51.494853 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:52.367592 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:52.367563 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kf2dg" Jul 20 15:56:56.395893 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.395855 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb"] Jul 20 15:56:56.396285 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.396215 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" containerName="registry-server" Jul 20 15:56:56.396285 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.396227 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" containerName="registry-server" Jul 20 15:56:56.396355 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.396293 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fb20efd-3c73-4036-bdf5-1f587d5c727d" containerName="registry-server" Jul 20 15:56:56.399299 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.399278 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.401984 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.401951 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vwqfz\"" Jul 20 15:56:56.408783 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.408757 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb"] Jul 20 15:56:56.540402 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.540368 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.540402 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.540407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.540607 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.540509 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fjv\" (UniqueName: \"kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.641138 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.641090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fjv\" (UniqueName: \"kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.641349 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.641226 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.641349 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.641260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.641654 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.641630 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.641724 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.641678 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.649602 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.649539 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fjv\" (UniqueName: \"kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.709187 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.709138 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:56:56.839954 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.839929 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb"] Jul 20 15:56:56.841982 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:56.841958 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba5f472_ec4b_4c19_b77c_78516b089e5e.slice/crio-f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81 WatchSource:0}: Error finding container f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81: Status 404 returned error can't find the container with id f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81 Jul 20 15:56:56.993267 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.993233 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2"] Jul 20 15:56:56.996699 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:56.996681 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.005626 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.005600 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2"] Jul 20 15:56:57.146655 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.146618 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.146835 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.146661 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.146835 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.146691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.247525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.247473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.247525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.247532 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.247776 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.247566 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.247873 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.247852 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.247929 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.247882 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.256936 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.256914 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.306511 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.306476 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:56:57.370791 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.370753 2585 generic.go:356] "Generic (PLEG): container finished" podID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerID="18b6765414c088bb26ca7c3c84e6ee278a13f6658f31a88ef569e37432f0b136" exitCode=0 Jul 20 15:56:57.370971 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.370838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" event={"ID":"0ba5f472-ec4b-4c19-b77c-78516b089e5e","Type":"ContainerDied","Data":"18b6765414c088bb26ca7c3c84e6ee278a13f6658f31a88ef569e37432f0b136"} Jul 20 15:56:57.370971 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.370948 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" event={"ID":"0ba5f472-ec4b-4c19-b77c-78516b089e5e","Type":"ContainerStarted","Data":"f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81"} Jul 20 15:56:57.411425 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.411386 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g"] Jul 20 15:56:57.416131 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.416103 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.426873 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.426842 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g"] Jul 20 15:56:57.445383 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.445355 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2"] Jul 20 15:56:57.446866 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:57.446839 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bbe382_7449_47b7_9972_58e909795627.slice/crio-3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701 WatchSource:0}: Error finding container 3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701: Status 404 returned error can't find the container with id 3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701 Jul 20 15:56:57.550554 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.550528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.550675 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.550584 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdh8h\" (UniqueName: \"kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.550675 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.550605 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.651944 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.651907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.652132 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.651980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdh8h\" (UniqueName: \"kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.652132 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.652011 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.652402 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.652377 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.652402 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.652392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.661858 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.661836 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdh8h\" (UniqueName: \"kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.729125 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.729093 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:56:57.798391 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.798358 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw"] Jul 20 15:56:57.802881 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.802857 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.811355 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.811332 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw"] Jul 20 15:56:57.853791 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.853750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.853965 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.853797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.853965 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.853906 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8brd\" (UniqueName: \"kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.873354 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.873326 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g"] Jul 20 15:56:57.874610 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:57.874583 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125ebd04_3074_4b20_ade4_f1991008b1fa.slice/crio-985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be WatchSource:0}: Error finding container 985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be: Status 404 returned error can't find the container with id 985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be Jul 20 15:56:57.955024 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.954993 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.955024 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.955028 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.955295 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.955091 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8brd\" (UniqueName: \"kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.955534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.955503 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.955534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.955526 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:57.966009 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:57.965986 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8brd\" (UniqueName: \"kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:58.113946 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.113857 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:56:58.270356 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.270329 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw"] Jul 20 15:56:58.333608 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:56:58.333576 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ae4455_2110_4046_8cc6_e1f01e960426.slice/crio-c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b WatchSource:0}: Error finding container c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b: Status 404 returned error can't find the container with id c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b Jul 20 15:56:58.377189 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.377091 2585 generic.go:356] "Generic (PLEG): container finished" podID="b3bbe382-7449-47b7-9972-58e909795627" containerID="91d36aeddb4707028a848282833f5768b1926696d61244becaef31007feef7b3" exitCode=0 Jul 20 15:56:58.377346 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.377183 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" event={"ID":"b3bbe382-7449-47b7-9972-58e909795627","Type":"ContainerDied","Data":"91d36aeddb4707028a848282833f5768b1926696d61244becaef31007feef7b3"} Jul 20 15:56:58.377346 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.377274 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" event={"ID":"b3bbe382-7449-47b7-9972-58e909795627","Type":"ContainerStarted","Data":"3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701"} Jul 20 15:56:58.378430 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.378406 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" event={"ID":"21ae4455-2110-4046-8cc6-e1f01e960426","Type":"ContainerStarted","Data":"c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b"} Jul 20 15:56:58.379811 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.379793 2585 generic.go:356] "Generic (PLEG): container finished" podID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerID="5febfb04d04121b52c19f695141126aa8a1a2cc6f7829fa9d8e6f6c71a570f99" exitCode=0 Jul 20 15:56:58.379897 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.379875 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerDied","Data":"5febfb04d04121b52c19f695141126aa8a1a2cc6f7829fa9d8e6f6c71a570f99"} Jul 20 15:56:58.379948 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:58.379921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerStarted","Data":"985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be"} Jul 20 15:56:59.387473 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:59.387439 2585 generic.go:356] "Generic (PLEG): container finished" podID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerID="77898547879de6e1752a60b120115330a70c395bcd24a38bc79269b4c9661926" exitCode=0 Jul 20 15:56:59.387889 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:59.387516 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" event={"ID":"0ba5f472-ec4b-4c19-b77c-78516b089e5e","Type":"ContainerDied","Data":"77898547879de6e1752a60b120115330a70c395bcd24a38bc79269b4c9661926"} Jul 20 15:56:59.389050 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:59.389023 2585 generic.go:356] "Generic (PLEG): container finished" podID="21ae4455-2110-4046-8cc6-e1f01e960426" containerID="6cf8562effa4cccd77a31dbba2b328914f88ccce68e5d849d608f41e8f569bc8" exitCode=0 Jul 20 15:56:59.389190 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:59.389114 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" event={"ID":"21ae4455-2110-4046-8cc6-e1f01e960426","Type":"ContainerDied","Data":"6cf8562effa4cccd77a31dbba2b328914f88ccce68e5d849d608f41e8f569bc8"} Jul 20 15:56:59.391202 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:56:59.391183 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerStarted","Data":"42d76bec23278a819e4fce811606c67aed89008293a05e660afd9a02f57c6c4a"} Jul 20 15:57:00.398799 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.398773 2585 generic.go:356] "Generic (PLEG): container finished" podID="21ae4455-2110-4046-8cc6-e1f01e960426" containerID="8f4dcbec7324dca192ef120c653f92f81d97a80065206bceeb7d2b9621f846d5" exitCode=0 Jul 20 15:57:00.399167 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.398850 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" event={"ID":"21ae4455-2110-4046-8cc6-e1f01e960426","Type":"ContainerDied","Data":"8f4dcbec7324dca192ef120c653f92f81d97a80065206bceeb7d2b9621f846d5"} Jul 20 15:57:00.400551 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.400531 2585 generic.go:356] "Generic (PLEG): container finished" podID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerID="42d76bec23278a819e4fce811606c67aed89008293a05e660afd9a02f57c6c4a" exitCode=0 Jul 20 15:57:00.400656 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.400638 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerDied","Data":"42d76bec23278a819e4fce811606c67aed89008293a05e660afd9a02f57c6c4a"} Jul 20 15:57:00.402869 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.402842 2585 generic.go:356] "Generic (PLEG): container finished" podID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerID="c043150d555bb266cf1b2d030d36c7293f34398c69f7f4922a4e94d584008461" exitCode=0 Jul 20 15:57:00.402983 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.402919 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" event={"ID":"0ba5f472-ec4b-4c19-b77c-78516b089e5e","Type":"ContainerDied","Data":"c043150d555bb266cf1b2d030d36c7293f34398c69f7f4922a4e94d584008461"} Jul 20 15:57:00.404768 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.404748 2585 generic.go:356] "Generic (PLEG): container finished" podID="b3bbe382-7449-47b7-9972-58e909795627" containerID="6db1c97f135dd9ece58258ac83ed2603cc58c3ef3f068a89f24564bae2818a2f" exitCode=0 Jul 20 15:57:00.404841 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:00.404820 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" event={"ID":"b3bbe382-7449-47b7-9972-58e909795627","Type":"ContainerDied","Data":"6db1c97f135dd9ece58258ac83ed2603cc58c3ef3f068a89f24564bae2818a2f"} Jul 20 15:57:01.412283 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.412247 2585 generic.go:356] "Generic (PLEG): container finished" podID="b3bbe382-7449-47b7-9972-58e909795627" containerID="6b327fa887ad8dad15400c860cd62a152fd84d1f2ea4bcb7bcdaf5b17551a02d" exitCode=0 Jul 20 15:57:01.412704 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.412327 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" event={"ID":"b3bbe382-7449-47b7-9972-58e909795627","Type":"ContainerDied","Data":"6b327fa887ad8dad15400c860cd62a152fd84d1f2ea4bcb7bcdaf5b17551a02d"} Jul 20 15:57:01.414375 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.414352 2585 generic.go:356] "Generic (PLEG): container finished" podID="21ae4455-2110-4046-8cc6-e1f01e960426" containerID="bcb3cdafc902998ce9f2820608145eac6f77dc08802ac47f57c55b7ac0e420ce" exitCode=0 Jul 20 15:57:01.414486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.414428 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" event={"ID":"21ae4455-2110-4046-8cc6-e1f01e960426","Type":"ContainerDied","Data":"bcb3cdafc902998ce9f2820608145eac6f77dc08802ac47f57c55b7ac0e420ce"} Jul 20 15:57:01.416459 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.416438 2585 generic.go:356] "Generic (PLEG): container finished" podID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerID="ca6078ffcda41af8684a686111add0548266a17aba7dc03b7df7cc37549e7096" exitCode=0 Jul 20 15:57:01.416562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.416510 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerDied","Data":"ca6078ffcda41af8684a686111add0548266a17aba7dc03b7df7cc37549e7096"} Jul 20 15:57:01.575281 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.575257 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:57:01.587306 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.587280 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util\") pod \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " Jul 20 15:57:01.587460 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.587364 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle\") pod \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " Jul 20 15:57:01.587460 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.587386 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6fjv\" (UniqueName: \"kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv\") pod \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\" (UID: \"0ba5f472-ec4b-4c19-b77c-78516b089e5e\") " Jul 20 15:57:01.587884 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.587858 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle" (OuterVolumeSpecName: "bundle") pod "0ba5f472-ec4b-4c19-b77c-78516b089e5e" (UID: "0ba5f472-ec4b-4c19-b77c-78516b089e5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:01.589497 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.589472 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv" (OuterVolumeSpecName: "kube-api-access-m6fjv") pod "0ba5f472-ec4b-4c19-b77c-78516b089e5e" (UID: "0ba5f472-ec4b-4c19-b77c-78516b089e5e"). InnerVolumeSpecName "kube-api-access-m6fjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:01.592778 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.592746 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util" (OuterVolumeSpecName: "util") pod "0ba5f472-ec4b-4c19-b77c-78516b089e5e" (UID: "0ba5f472-ec4b-4c19-b77c-78516b089e5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:01.688305 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.688274 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:01.688305 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.688303 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6fjv\" (UniqueName: \"kubernetes.io/projected/0ba5f472-ec4b-4c19-b77c-78516b089e5e-kube-api-access-m6fjv\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:01.688494 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:01.688318 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ba5f472-ec4b-4c19-b77c-78516b089e5e-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.423434 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.423398 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" Jul 20 15:57:02.423865 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.423441 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb" event={"ID":"0ba5f472-ec4b-4c19-b77c-78516b089e5e","Type":"ContainerDied","Data":"f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81"} Jul 20 15:57:02.423865 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.423484 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0d55d07017dbff59ab9890264846e48459c3f4d657948b783a6179b3fe90c81" Jul 20 15:57:02.569875 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.569851 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:57:02.594820 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.594773 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util\") pod \"125ebd04-3074-4b20-ade4-f1991008b1fa\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " Jul 20 15:57:02.594960 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.594847 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdh8h\" (UniqueName: \"kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h\") pod \"125ebd04-3074-4b20-ade4-f1991008b1fa\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " Jul 20 15:57:02.594960 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.594894 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle\") pod \"125ebd04-3074-4b20-ade4-f1991008b1fa\" (UID: \"125ebd04-3074-4b20-ade4-f1991008b1fa\") " Jul 20 15:57:02.596022 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.595990 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle" (OuterVolumeSpecName: "bundle") pod "125ebd04-3074-4b20-ade4-f1991008b1fa" (UID: "125ebd04-3074-4b20-ade4-f1991008b1fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.597534 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.597509 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h" (OuterVolumeSpecName: "kube-api-access-xdh8h") pod "125ebd04-3074-4b20-ade4-f1991008b1fa" (UID: "125ebd04-3074-4b20-ade4-f1991008b1fa"). InnerVolumeSpecName "kube-api-access-xdh8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:02.603708 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.603680 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util" (OuterVolumeSpecName: "util") pod "125ebd04-3074-4b20-ade4-f1991008b1fa" (UID: "125ebd04-3074-4b20-ade4-f1991008b1fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.620456 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.620436 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:57:02.623231 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.623209 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:57:02.696357 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696326 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util\") pod \"21ae4455-2110-4046-8cc6-e1f01e960426\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " Jul 20 15:57:02.696521 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696363 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util\") pod \"b3bbe382-7449-47b7-9972-58e909795627\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " Jul 20 15:57:02.696521 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696387 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8brd\" (UniqueName: \"kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd\") pod \"21ae4455-2110-4046-8cc6-e1f01e960426\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " Jul 20 15:57:02.696521 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696412 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle\") pod \"b3bbe382-7449-47b7-9972-58e909795627\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " Jul 20 15:57:02.696521 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696427 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle\") pod \"21ae4455-2110-4046-8cc6-e1f01e960426\" (UID: \"21ae4455-2110-4046-8cc6-e1f01e960426\") " Jul 20 15:57:02.696521 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696448 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf\") pod \"b3bbe382-7449-47b7-9972-58e909795627\" (UID: \"b3bbe382-7449-47b7-9972-58e909795627\") " Jul 20 15:57:02.696792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696622 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.696792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696638 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdh8h\" (UniqueName: \"kubernetes.io/projected/125ebd04-3074-4b20-ade4-f1991008b1fa-kube-api-access-xdh8h\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.696792 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696653 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125ebd04-3074-4b20-ade4-f1991008b1fa-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.696999 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.696974 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle" (OuterVolumeSpecName: "bundle") pod "b3bbe382-7449-47b7-9972-58e909795627" (UID: "b3bbe382-7449-47b7-9972-58e909795627"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.697201 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.697176 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle" (OuterVolumeSpecName: "bundle") pod "21ae4455-2110-4046-8cc6-e1f01e960426" (UID: "21ae4455-2110-4046-8cc6-e1f01e960426"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.698612 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.698591 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd" (OuterVolumeSpecName: "kube-api-access-p8brd") pod "21ae4455-2110-4046-8cc6-e1f01e960426" (UID: "21ae4455-2110-4046-8cc6-e1f01e960426"). InnerVolumeSpecName "kube-api-access-p8brd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:02.698733 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.698708 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf" (OuterVolumeSpecName: "kube-api-access-9t6zf") pod "b3bbe382-7449-47b7-9972-58e909795627" (UID: "b3bbe382-7449-47b7-9972-58e909795627"). InnerVolumeSpecName "kube-api-access-9t6zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:02.702036 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.702002 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util" (OuterVolumeSpecName: "util") pod "21ae4455-2110-4046-8cc6-e1f01e960426" (UID: "21ae4455-2110-4046-8cc6-e1f01e960426"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.786004 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.785961 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util" (OuterVolumeSpecName: "util") pod "b3bbe382-7449-47b7-9972-58e909795627" (UID: "b3bbe382-7449-47b7-9972-58e909795627"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:02.797112 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797085 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8brd\" (UniqueName: \"kubernetes.io/projected/21ae4455-2110-4046-8cc6-e1f01e960426-kube-api-access-p8brd\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.797112 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797111 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.797247 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797123 2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.797247 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797131 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t6zf\" (UniqueName: \"kubernetes.io/projected/b3bbe382-7449-47b7-9972-58e909795627-kube-api-access-9t6zf\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.797247 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797140 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21ae4455-2110-4046-8cc6-e1f01e960426-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:02.797247 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:02.797148 2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3bbe382-7449-47b7-9972-58e909795627-util\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:03.430329 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.430296 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" Jul 20 15:57:03.430707 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.430300 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2" event={"ID":"b3bbe382-7449-47b7-9972-58e909795627","Type":"ContainerDied","Data":"3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701"} Jul 20 15:57:03.430707 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.430435 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3666b9a6c60df280797816de02657e907a4e4e278625e5c75bad42a1d92be701" Jul 20 15:57:03.432181 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.432143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" event={"ID":"21ae4455-2110-4046-8cc6-e1f01e960426","Type":"ContainerDied","Data":"c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b"} Jul 20 15:57:03.432181 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.432175 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw" Jul 20 15:57:03.432360 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.432195 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c99bac38ed3d7ae3e3f152db68e6deb747843cac224a4c6205e257ff29bfe07b" Jul 20 15:57:03.434169 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.434136 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" Jul 20 15:57:03.434297 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.434130 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g" event={"ID":"125ebd04-3074-4b20-ade4-f1991008b1fa","Type":"ContainerDied","Data":"985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be"} Jul 20 15:57:03.434297 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:03.434262 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="985714ba2e32f9b2e1e9e81544ff792f0c0e3ba41ea0650701cd1573921fc3be" Jul 20 15:57:14.263093 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263052 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg"] Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263427 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263445 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263455 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263460 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263469 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263475 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263484 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263489 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263499 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263504 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263513 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263518 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263526 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263530 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="extract" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263541 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263546 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263554 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263559 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263566 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263571 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263577 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263582 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="pull" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263590 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="util" Jul 20 15:57:14.263594 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263594 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="util" Jul 20 15:57:14.264291 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263644 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="125ebd04-3074-4b20-ade4-f1991008b1fa" containerName="extract" Jul 20 15:57:14.264291 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263654 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ba5f472-ec4b-4c19-b77c-78516b089e5e" containerName="extract" Jul 20 15:57:14.264291 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263661 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ae4455-2110-4046-8cc6-e1f01e960426" containerName="extract" Jul 20 15:57:14.264291 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.263666 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bbe382-7449-47b7-9972-58e909795627" containerName="extract" Jul 20 15:57:14.268207 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.268190 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.273333 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.273303 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ghj5c\"" Jul 20 15:57:14.284167 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.284129 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg"] Jul 20 15:57:14.292898 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.292873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsmh\" (UniqueName: \"kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.293047 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.292911 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.393436 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.393386 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsmh\" (UniqueName: \"kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.393632 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.393443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.393859 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.393837 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.407907 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.407871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsmh\" (UniqueName: \"kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.577699 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.577611 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:14.717745 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:14.717720 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg"] Jul 20 15:57:14.719597 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:57:14.719570 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee005c7_d45e_406e_88ff_9b7e90d832d8.slice/crio-b8992c56a3f5d95390d3365c4067e0145fbc8935c932b3c153cbfdfdb4e1de9b WatchSource:0}: Error finding container b8992c56a3f5d95390d3365c4067e0145fbc8935c932b3c153cbfdfdb4e1de9b: Status 404 returned error can't find the container with id b8992c56a3f5d95390d3365c4067e0145fbc8935c932b3c153cbfdfdb4e1de9b Jul 20 15:57:15.496827 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:15.496786 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" event={"ID":"4ee005c7-d45e-406e-88ff-9b7e90d832d8","Type":"ContainerStarted","Data":"b8992c56a3f5d95390d3365c4067e0145fbc8935c932b3c153cbfdfdb4e1de9b"} Jul 20 15:57:20.526599 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:20.526567 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" event={"ID":"4ee005c7-d45e-406e-88ff-9b7e90d832d8","Type":"ContainerStarted","Data":"e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220"} Jul 20 15:57:20.527025 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:20.526682 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:20.548754 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:20.548690 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" podStartSLOduration=0.937572422 podStartE2EDuration="6.54867016s" totalImagesPullingTime="5.611097738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:20.546594721 +0000 UTC m=+417.493050375" watchObservedRunningTime="2026-07-20 15:57:20.54867016 +0000 UTC m=+417.495125816" Jul 20 15:57:22.602975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.602941 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv"] Jul 20 15:57:22.606371 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.606355 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:22.609029 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.609009 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vzx7g\"" Jul 20 15:57:22.609287 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.609271 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 15:57:22.623486 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.623463 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv"] Jul 20 15:57:22.665381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.665345 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnqwq\" (UniqueName: \"kubernetes.io/projected/9ac1e0d4-30b5-4102-b4d3-492c17221b46-kube-api-access-tnqwq\") pod \"dns-operator-controller-manager-864dd78c4c-52jtv\" (UID: \"9ac1e0d4-30b5-4102-b4d3-492c17221b46\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:22.766765 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.766730 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnqwq\" (UniqueName: \"kubernetes.io/projected/9ac1e0d4-30b5-4102-b4d3-492c17221b46-kube-api-access-tnqwq\") pod \"dns-operator-controller-manager-864dd78c4c-52jtv\" (UID: \"9ac1e0d4-30b5-4102-b4d3-492c17221b46\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:22.779666 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.779640 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnqwq\" (UniqueName: \"kubernetes.io/projected/9ac1e0d4-30b5-4102-b4d3-492c17221b46-kube-api-access-tnqwq\") pod \"dns-operator-controller-manager-864dd78c4c-52jtv\" (UID: \"9ac1e0d4-30b5-4102-b4d3-492c17221b46\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:22.916147 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:22.916051 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:23.062075 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.062048 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv"] Jul 20 15:57:23.063927 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:57:23.063903 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac1e0d4_30b5_4102_b4d3_492c17221b46.slice/crio-c804975fab84d72e82bd7174bc128ef89d79d5626366acaf6d60cb4ed47f99de WatchSource:0}: Error finding container c804975fab84d72e82bd7174bc128ef89d79d5626366acaf6d60cb4ed47f99de: Status 404 returned error can't find the container with id c804975fab84d72e82bd7174bc128ef89d79d5626366acaf6d60cb4ed47f99de Jul 20 15:57:23.493180 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.493127 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk"] Jul 20 15:57:23.498006 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.497988 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.501339 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.501321 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 20 15:57:23.501498 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.501480 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vwqfz\"" Jul 20 15:57:23.503084 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.503065 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 20 15:57:23.514679 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.514653 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk"] Jul 20 15:57:23.544103 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.544069 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" event={"ID":"9ac1e0d4-30b5-4102-b4d3-492c17221b46","Type":"ContainerStarted","Data":"c804975fab84d72e82bd7174bc128ef89d79d5626366acaf6d60cb4ed47f99de"} Jul 20 15:57:23.573573 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.573535 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.573740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.573591 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.573740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.573621 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5mh\" (UniqueName: \"kubernetes.io/projected/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-kube-api-access-4p5mh\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.674466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.674433 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.674909 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.674482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5mh\" (UniqueName: \"kubernetes.io/projected/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-kube-api-access-4p5mh\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.674909 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.674548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.675043 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.675021 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.676906 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.676885 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.686539 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.686509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5mh\" (UniqueName: \"kubernetes.io/projected/d542ee88-20e4-4a70-b1df-4ce553bfdd1d-kube-api-access-4p5mh\") pod \"kuadrant-console-plugin-66b5774985-jjbzk\" (UID: \"d542ee88-20e4-4a70-b1df-4ce553bfdd1d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:23.807510 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:23.807435 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" Jul 20 15:57:24.189890 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:24.189858 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk"] Jul 20 15:57:24.240761 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:57:24.240723 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd542ee88_20e4_4a70_b1df_4ce553bfdd1d.slice/crio-1d788ebe459eaa52b314b73cf25266c9dc7d1dab7de3aa18e2ccc622f57d39cb WatchSource:0}: Error finding container 1d788ebe459eaa52b314b73cf25266c9dc7d1dab7de3aa18e2ccc622f57d39cb: Status 404 returned error can't find the container with id 1d788ebe459eaa52b314b73cf25266c9dc7d1dab7de3aa18e2ccc622f57d39cb Jul 20 15:57:24.551518 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:24.551477 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" event={"ID":"d542ee88-20e4-4a70-b1df-4ce553bfdd1d","Type":"ContainerStarted","Data":"1d788ebe459eaa52b314b73cf25266c9dc7d1dab7de3aa18e2ccc622f57d39cb"} Jul 20 15:57:25.198807 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:25.198780 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 20 15:57:25.558849 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:25.558761 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" event={"ID":"9ac1e0d4-30b5-4102-b4d3-492c17221b46","Type":"ContainerStarted","Data":"c452ec358618ee22cfee5f1926f545f97aa9c8ad3a18dbf6a807ffc2aa6a4af3"} Jul 20 15:57:25.558849 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:25.558838 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:25.596121 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:25.596060 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" podStartSLOduration=1.466988909 podStartE2EDuration="3.596043353s" totalImagesPullingTime="2.129054444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:25.595346837 +0000 UTC m=+422.541802496" watchObservedRunningTime="2026-07-20 15:57:25.596043353 +0000 UTC m=+422.542499008" Jul 20 15:57:31.540654 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:31.540615 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:33.966509 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:33.966475 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg"] Jul 20 15:57:33.966967 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:33.966700 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" containerName="manager" containerID="cri-o://e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220" gracePeriod=2 Jul 20 15:57:34.002659 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.002623 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg"] Jul 20 15:57:34.007014 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:34.006966 2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4ee005c7-d45e-406e-88ff-9b7e90d832d8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:34.007646 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.007618 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:34.008064 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.008047 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" containerName="manager" Jul 20 15:57:34.008143 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.008068 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" containerName="manager" Jul 20 15:57:34.008243 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.008174 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" containerName="manager" Jul 20 15:57:34.012890 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.012866 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.044982 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.044932 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:34.072028 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:34.071991 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:34.178101 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.178058 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.178309 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.178119 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5qx\" (UniqueName: \"kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.279274 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.279197 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.279274 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.279246 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5qx\" (UniqueName: \"kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.279673 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.279634 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.297030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.296998 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5qx\" (UniqueName: \"kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpb5j\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:34.361297 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:34.361262 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:36.191500 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.191401 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 15:57:36.245922 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.245883 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 15:57:36.246094 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.246004 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.400773 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.400736 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-526vn\" (UniqueName: \"kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.400942 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.400805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.502196 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.502105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-526vn\" (UniqueName: \"kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.502370 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.502201 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.502625 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.502598 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.512021 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.511990 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-526vn\" (UniqueName: \"kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn\") pod \"kuadrant-operator-controller-manager-86878c769f-st8t8\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.559074 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.559042 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:36.567432 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:36.567399 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-52jtv" Jul 20 15:57:46.158757 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.158725 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:46.159229 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:57:46.159067 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f7e1af_3d93_4c1f_aa72_513a3387a764.slice/crio-94003bf1ededab48823e1d97c6263c29234449064b429d860d18586818edd8e6 WatchSource:0}: Error finding container 94003bf1ededab48823e1d97c6263c29234449064b429d860d18586818edd8e6: Status 404 returned error can't find the container with id 94003bf1ededab48823e1d97c6263c29234449064b429d860d18586818edd8e6 Jul 20 15:57:46.163013 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.162987 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:46.165229 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:46.165199 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:46.192131 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.191971 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 15:57:46.192484 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:57:46.192458 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0b26c1_6a42_48cb_9307_252196dc1a37.slice/crio-425397dd476c3ad6e64a24c1e25945586af6ec6499a5780df43614502904e083 WatchSource:0}: Error finding container 425397dd476c3ad6e64a24c1e25945586af6ec6499a5780df43614502904e083: Status 404 returned error can't find the container with id 425397dd476c3ad6e64a24c1e25945586af6ec6499a5780df43614502904e083 Jul 20 15:57:46.200523 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.200407 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsmh\" (UniqueName: \"kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh\") pod \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " Jul 20 15:57:46.200523 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.200461 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume\") pod \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\" (UID: \"4ee005c7-d45e-406e-88ff-9b7e90d832d8\") " Jul 20 15:57:46.200927 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.200893 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ee005c7-d45e-406e-88ff-9b7e90d832d8" (UID: "4ee005c7-d45e-406e-88ff-9b7e90d832d8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:46.203221 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.203186 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh" (OuterVolumeSpecName: "kube-api-access-lhsmh") pod "4ee005c7-d45e-406e-88ff-9b7e90d832d8" (UID: "4ee005c7-d45e-406e-88ff-9b7e90d832d8"). InnerVolumeSpecName "kube-api-access-lhsmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:46.301837 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.301747 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsmh\" (UniqueName: \"kubernetes.io/projected/4ee005c7-d45e-406e-88ff-9b7e90d832d8-kube-api-access-lhsmh\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:46.301837 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.301782 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ee005c7-d45e-406e-88ff-9b7e90d832d8-extensions-socket-volume\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:46.689689 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.689654 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" event={"ID":"d542ee88-20e4-4a70-b1df-4ce553bfdd1d","Type":"ContainerStarted","Data":"f049db44070e4d38cce32f0d61b04decb4a715f938fc5fd2e5b1e143fdb4d089"} Jul 20 15:57:46.691360 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.691335 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" event={"ID":"b4f7e1af-3d93-4c1f-aa72-513a3387a764","Type":"ContainerStarted","Data":"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36"} Jul 20 15:57:46.691511 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.691376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" event={"ID":"b4f7e1af-3d93-4c1f-aa72-513a3387a764","Type":"ContainerStarted","Data":"94003bf1ededab48823e1d97c6263c29234449064b429d860d18586818edd8e6"} Jul 20 15:57:46.691511 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.691445 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:46.692196 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:46.692146 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:46.693128 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.693102 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" event={"ID":"0a0b26c1-6a42-48cb-9307-252196dc1a37","Type":"ContainerStarted","Data":"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9"} Jul 20 15:57:46.693514 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.693137 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" event={"ID":"0a0b26c1-6a42-48cb-9307-252196dc1a37","Type":"ContainerStarted","Data":"425397dd476c3ad6e64a24c1e25945586af6ec6499a5780df43614502904e083"} Jul 20 15:57:46.693514 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.693211 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:46.694556 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.694527 2585 generic.go:356] "Generic (PLEG): container finished" podID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" containerID="e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220" exitCode=0 Jul 20 15:57:46.694643 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.694558 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:46.694643 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.694614 2585 scope.go:117] "RemoveContainer" containerID="e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220" Jul 20 15:57:46.704119 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.704094 2585 scope.go:117] "RemoveContainer" containerID="e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220" Jul 20 15:57:46.704474 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:46.704450 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220\": container with ID starting with e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220 not found: ID does not exist" containerID="e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220" Jul 20 15:57:46.704530 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.704487 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220"} err="failed to get container status \"e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220\": rpc error: code = NotFound desc = could not find container \"e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220\": container with ID starting with e744a0216c6b351aef68e07f726cafdf613a9189236cb3fdd34c20c02346a220 not found: ID does not exist" Jul 20 15:57:46.719149 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.719086 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjbzk" podStartSLOduration=1.8594263610000001 podStartE2EDuration="23.719071008s" totalImagesPullingTime="21.859644647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:46.717030968 +0000 UTC m=+443.663486624" watchObservedRunningTime="2026-07-20 15:57:46.719071008 +0000 UTC m=+443.665526664" Jul 20 15:57:46.807482 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.807431 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" podStartSLOduration=10.807414582 podStartE2EDuration="10.807414582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:46.752329951 +0000 UTC m=+443.698785606" watchObservedRunningTime="2026-07-20 15:57:46.807414582 +0000 UTC m=+443.753870237" Jul 20 15:57:46.808138 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:46.808104 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cxnjg\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cxnjg" Jul 20 15:57:46.808989 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:46.808952 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" podStartSLOduration=13.80893965 podStartE2EDuration="13.80893965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:46.805953777 +0000 UTC m=+443.752409431" watchObservedRunningTime="2026-07-20 15:57:46.80893965 +0000 UTC m=+443.755395304" Jul 20 15:57:47.540591 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:47.540557 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee005c7-d45e-406e-88ff-9b7e90d832d8" path="/var/lib/kubelet/pods/4ee005c7-d45e-406e-88ff-9b7e90d832d8/volumes" Jul 20 15:57:57.703607 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:57.703575 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 15:57:57.704021 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:57.703728 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:57.828645 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:57.828610 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:57.828883 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:57.828835 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" podUID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" containerName="manager" containerID="cri-o://7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36" gracePeriod=10 Jul 20 15:57:58.082302 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.082274 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:58.199679 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.199644 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j5qx\" (UniqueName: \"kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx\") pod \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " Jul 20 15:57:58.199866 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.199763 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume\") pod \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\" (UID: \"b4f7e1af-3d93-4c1f-aa72-513a3387a764\") " Jul 20 15:57:58.200130 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.200105 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b4f7e1af-3d93-4c1f-aa72-513a3387a764" (UID: "b4f7e1af-3d93-4c1f-aa72-513a3387a764"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 15:57:58.201730 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.201700 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx" (OuterVolumeSpecName: "kube-api-access-2j5qx") pod "b4f7e1af-3d93-4c1f-aa72-513a3387a764" (UID: "b4f7e1af-3d93-4c1f-aa72-513a3387a764"). InnerVolumeSpecName "kube-api-access-2j5qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:57:58.300484 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.300415 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j5qx\" (UniqueName: \"kubernetes.io/projected/b4f7e1af-3d93-4c1f-aa72-513a3387a764-kube-api-access-2j5qx\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:58.300484 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.300438 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4f7e1af-3d93-4c1f-aa72-513a3387a764-extensions-socket-volume\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:57:58.760727 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.760697 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" containerID="7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36" exitCode=0 Jul 20 15:57:58.761216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.760740 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" event={"ID":"b4f7e1af-3d93-4c1f-aa72-513a3387a764","Type":"ContainerDied","Data":"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36"} Jul 20 15:57:58.761216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.760744 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" Jul 20 15:57:58.761216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.760783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j" event={"ID":"b4f7e1af-3d93-4c1f-aa72-513a3387a764","Type":"ContainerDied","Data":"94003bf1ededab48823e1d97c6263c29234449064b429d860d18586818edd8e6"} Jul 20 15:57:58.761216 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.760804 2585 scope.go:117] "RemoveContainer" containerID="7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36" Jul 20 15:57:58.770499 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.770483 2585 scope.go:117] "RemoveContainer" containerID="7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36" Jul 20 15:57:58.770754 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:57:58.770735 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36\": container with ID starting with 7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36 not found: ID does not exist" containerID="7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36" Jul 20 15:57:58.770800 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.770763 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36"} err="failed to get container status \"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36\": rpc error: code = NotFound desc = could not find container \"7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36\": container with ID starting with 7d75175f1a7bf49ab73989149d87a7606249b9501d764511bd60092c5bc68e36 not found: ID does not exist" Jul 20 15:57:58.789801 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.789761 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:58.800054 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:58.800028 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpb5j"] Jul 20 15:57:59.542703 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:57:59.542668 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" path="/var/lib/kubelet/pods/b4f7e1af-3d93-4c1f-aa72-513a3387a764/volumes" Jul 20 15:58:14.549334 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.549298 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925"] Jul 20 15:58:14.549934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.549661 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" containerName="manager" Jul 20 15:58:14.549934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.549673 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" containerName="manager" Jul 20 15:58:14.549934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.549733 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f7e1af-3d93-4c1f-aa72-513a3387a764" containerName="manager" Jul 20 15:58:14.774477 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.774439 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925"] Jul 20 15:58:14.774646 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.774570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.777522 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.777498 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6qkkn\"" Jul 20 15:58:14.848136 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848057 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848136 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848099 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xx4z\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-kube-api-access-9xx4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848235 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848268 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848372 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.848397 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.848395 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949109 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949070 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949109 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949111 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xx4z\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-kube-api-access-9xx4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949186 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949319 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949381 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949375 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949580 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949413 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949580 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949580 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949489 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949580 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949499 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949580 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949553 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949835 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949750 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.949890 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.949864 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.950077 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.950055 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.951620 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.951602 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.951964 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.951942 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.958814 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.958785 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:14.959051 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:14.959035 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xx4z\" (UniqueName: \"kubernetes.io/projected/c2e9747c-5dd6-44c4-b1f1-4d59facfd449-kube-api-access-9xx4z\") pod \"maas-default-gateway-openshift-default-56654dcf7-5t925\" (UID: \"c2e9747c-5dd6-44c4-b1f1-4d59facfd449\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:15.085402 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.085370 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:15.291049 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.291016 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925"] Jul 20 15:58:15.291281 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:58:15.291258 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e9747c_5dd6_44c4_b1f1_4d59facfd449.slice/crio-3a3b6e968e3bec4c969fa4475a347925777f962d9d087fe716d67422635b458b WatchSource:0}: Error finding container 3a3b6e968e3bec4c969fa4475a347925777f962d9d087fe716d67422635b458b: Status 404 returned error can't find the container with id 3a3b6e968e3bec4c969fa4475a347925777f962d9d087fe716d67422635b458b Jul 20 15:58:15.293313 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.293283 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:58:15.293383 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.293345 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:58:15.293383 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.293377 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:58:15.854117 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.854081 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" event={"ID":"c2e9747c-5dd6-44c4-b1f1-4d59facfd449","Type":"ContainerStarted","Data":"980f2f7bd7699d554b4c5f199949ceaf239c71341944bbea8fa0d1c994f167f5"} Jul 20 15:58:15.854507 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.854192 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" event={"ID":"c2e9747c-5dd6-44c4-b1f1-4d59facfd449","Type":"ContainerStarted","Data":"3a3b6e968e3bec4c969fa4475a347925777f962d9d087fe716d67422635b458b"} Jul 20 15:58:15.877015 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:15.876964 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" podStartSLOduration=1.876950909 podStartE2EDuration="1.876950909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:15.874934375 +0000 UTC m=+472.821390034" watchObservedRunningTime="2026-07-20 15:58:15.876950909 +0000 UTC m=+472.823406563" Jul 20 15:58:16.085740 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:16.085705 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:16.090952 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:16.090925 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:16.861557 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:16.861525 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:16.862525 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:16.862503 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:58:17.256112 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.256078 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 15:58:17.285147 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.285116 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 15:58:17.285311 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.285232 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.286137 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.286115 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 15:58:17.287634 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.287617 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 20 15:58:17.371361 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.371324 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92r6j\" (UniqueName: \"kubernetes.io/projected/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-kube-api-access-92r6j\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.371536 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.371368 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-config-file\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.472076 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.472038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92r6j\" (UniqueName: \"kubernetes.io/projected/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-kube-api-access-92r6j\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.472278 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.472080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-config-file\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.472762 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.472744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-config-file\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.484644 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.484617 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92r6j\" (UniqueName: \"kubernetes.io/projected/2b471cd3-2ccd-46a6-83e6-8c31016c3ea1-kube-api-access-92r6j\") pod \"limitador-limitador-54d6d988d5-92hvm\" (UID: \"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.596505 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.596421 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:17.765449 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.765424 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 15:58:17.767295 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:58:17.767252 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b471cd3_2ccd_46a6_83e6_8c31016c3ea1.slice/crio-cdff816892ef3e67d5bdca29178ac5a261d7024e42053e10e6be207301709825 WatchSource:0}: Error finding container cdff816892ef3e67d5bdca29178ac5a261d7024e42053e10e6be207301709825: Status 404 returned error can't find the container with id cdff816892ef3e67d5bdca29178ac5a261d7024e42053e10e6be207301709825 Jul 20 15:58:17.868242 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.868136 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" event={"ID":"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1","Type":"ContainerStarted","Data":"cdff816892ef3e67d5bdca29178ac5a261d7024e42053e10e6be207301709825"} Jul 20 15:58:17.916857 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.916818 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:17.919718 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.919695 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:17.922286 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.922268 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jlc4r\"" Jul 20 15:58:17.930922 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.930899 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:17.976887 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:17.976856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7\") pod \"authorino-75d556bd77-zpspm\" (UID: \"58cbc2a6-1cde-476d-960c-8ff8486a6d45\") " pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:18.077934 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:18.077896 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7\") pod \"authorino-75d556bd77-zpspm\" (UID: \"58cbc2a6-1cde-476d-960c-8ff8486a6d45\") " pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:18.086494 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:18.086467 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7\") pod \"authorino-75d556bd77-zpspm\" (UID: \"58cbc2a6-1cde-476d-960c-8ff8486a6d45\") " pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:18.229344 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:18.229311 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:18.405282 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:18.405249 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:18.416683 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:58:18.416641 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58cbc2a6_1cde_476d_960c_8ff8486a6d45.slice/crio-b00bfd85e8a2565f3e0629aa24ac938db502cfcf316638eb444dca549f35b24e WatchSource:0}: Error finding container b00bfd85e8a2565f3e0629aa24ac938db502cfcf316638eb444dca549f35b24e: Status 404 returned error can't find the container with id b00bfd85e8a2565f3e0629aa24ac938db502cfcf316638eb444dca549f35b24e Jul 20 15:58:18.875562 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:18.875523 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpspm" event={"ID":"58cbc2a6-1cde-476d-960c-8ff8486a6d45","Type":"ContainerStarted","Data":"b00bfd85e8a2565f3e0629aa24ac938db502cfcf316638eb444dca549f35b24e"} Jul 20 15:58:22.903133 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:22.903098 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpspm" event={"ID":"58cbc2a6-1cde-476d-960c-8ff8486a6d45","Type":"ContainerStarted","Data":"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76"} Jul 20 15:58:22.904643 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:22.904611 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" event={"ID":"2b471cd3-2ccd-46a6-83e6-8c31016c3ea1","Type":"ContainerStarted","Data":"d6aa47b6353354012e0dc0ca9bd03c65da0625370333b4d9d73ea2b4659727e6"} Jul 20 15:58:22.904769 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:22.904694 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:22.925048 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:22.925005 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zpspm" podStartSLOduration=2.092782054 podStartE2EDuration="5.924990713s" totalImagesPullingTime="3.832208659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:22.923433773 +0000 UTC m=+479.869889427" watchObservedRunningTime="2026-07-20 15:58:22.924990713 +0000 UTC m=+479.871446345" Jul 20 15:58:22.948294 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:22.948238 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" podStartSLOduration=1.473786387 podStartE2EDuration="5.948218339s" totalImagesPullingTime="4.474431952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:22.944765055 +0000 UTC m=+479.891220710" watchObservedRunningTime="2026-07-20 15:58:22.948218339 +0000 UTC m=+479.894673995" Jul 20 15:58:33.911739 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:33.911708 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-92hvm" Jul 20 15:58:51.432485 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.432453 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:51.436061 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.436044 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:51.443527 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.443460 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:51.460193 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.460140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zft\" (UniqueName: \"kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft\") pod \"authorino-5d4b67c446-bhc2m\" (UID: \"78dc68ff-6687-4d4b-9997-3af87f9e616f\") " pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:51.561308 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.561276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zft\" (UniqueName: \"kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft\") pod \"authorino-5d4b67c446-bhc2m\" (UID: \"78dc68ff-6687-4d4b-9997-3af87f9e616f\") " pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:51.570166 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.570136 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zft\" (UniqueName: \"kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft\") pod \"authorino-5d4b67c446-bhc2m\" (UID: \"78dc68ff-6687-4d4b-9997-3af87f9e616f\") " pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:51.676984 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.676942 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:51.677238 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.677216 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:51.704555 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.704530 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6df49b6d77-xvxnp"] Jul 20 15:58:51.709011 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.708992 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:51.715643 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.715617 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df49b6d77-xvxnp"] Jul 20 15:58:51.762818 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.762772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2q4v\" (UniqueName: \"kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v\") pod \"authorino-6df49b6d77-xvxnp\" (UID: \"1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a\") " pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:51.792407 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.792364 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6df49b6d77-xvxnp"] Jul 20 15:58:51.792674 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:58:51.792653 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-w2q4v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6df49b6d77-xvxnp" podUID="1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a" Jul 20 15:58:51.820881 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.820831 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 15:58:51.822581 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:58:51.822549 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78dc68ff_6687_4d4b_9997_3af87f9e616f.slice/crio-5662fb5114318aa0e0df7ca8a17321f4b2fbe77e05a64dd4d25c490ee0389205 WatchSource:0}: Error finding container 5662fb5114318aa0e0df7ca8a17321f4b2fbe77e05a64dd4d25c490ee0389205: Status 404 returned error can't find the container with id 5662fb5114318aa0e0df7ca8a17321f4b2fbe77e05a64dd4d25c490ee0389205 Jul 20 15:58:51.824340 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.824319 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:51.824428 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.824416 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.826900 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.826884 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 20 15:58:51.832607 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.832584 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 15:58:51.863837 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.863809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2q4v\" (UniqueName: \"kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v\") pod \"authorino-6df49b6d77-xvxnp\" (UID: \"1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a\") " pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:51.863974 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.863856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.863974 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.863876 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww77t\" (UniqueName: \"kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.872256 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.872235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2q4v\" (UniqueName: \"kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v\") pod \"authorino-6df49b6d77-xvxnp\" (UID: \"1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a\") " pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:51.965193 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.965084 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.965193 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.965124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww77t\" (UniqueName: \"kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.967551 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.967531 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:51.972951 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:51.972929 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww77t\" (UniqueName: \"kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t\") pod \"authorino-54b6fdf78f-57s75\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:52.060172 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.060129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" event={"ID":"78dc68ff-6687-4d4b-9997-3af87f9e616f","Type":"ContainerStarted","Data":"5662fb5114318aa0e0df7ca8a17321f4b2fbe77e05a64dd4d25c490ee0389205"} Jul 20 15:58:52.060337 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.060231 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:52.067561 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.067533 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:52.140324 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.140292 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 15:58:52.166843 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.166824 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2q4v\" (UniqueName: \"kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v\") pod \"1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a\" (UID: \"1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a\") " Jul 20 15:58:52.168797 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.168771 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v" (OuterVolumeSpecName: "kube-api-access-w2q4v") pod "1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a" (UID: "1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a"). InnerVolumeSpecName "kube-api-access-w2q4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:58:52.267975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.267776 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2q4v\" (UniqueName: \"kubernetes.io/projected/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a-kube-api-access-w2q4v\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:58:52.300930 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:52.300872 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 15:58:52.302456 ip-10-0-138-33 kubenswrapper[2585]: W0720 15:58:52.302430 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d513170_bd19_46c7_ae41_126dacabd3f1.slice/crio-cc3363195494018c44df4d7c1b5527cf266fb3238a5829f3e0f75a14653d96d8 WatchSource:0}: Error finding container cc3363195494018c44df4d7c1b5527cf266fb3238a5829f3e0f75a14653d96d8: Status 404 returned error can't find the container with id cc3363195494018c44df4d7c1b5527cf266fb3238a5829f3e0f75a14653d96d8 Jul 20 15:58:53.067645 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.067608 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" event={"ID":"78dc68ff-6687-4d4b-9997-3af87f9e616f","Type":"ContainerStarted","Data":"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b"} Jul 20 15:58:53.068095 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.067683 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" podUID="78dc68ff-6687-4d4b-9997-3af87f9e616f" containerName="authorino" containerID="cri-o://afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b" gracePeriod=30 Jul 20 15:58:53.069111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.069089 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df49b6d77-xvxnp" Jul 20 15:58:53.069111 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.069113 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b6fdf78f-57s75" event={"ID":"8d513170-bd19-46c7-ae41-126dacabd3f1","Type":"ContainerStarted","Data":"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6"} Jul 20 15:58:53.069302 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.069145 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b6fdf78f-57s75" event={"ID":"8d513170-bd19-46c7-ae41-126dacabd3f1","Type":"ContainerStarted","Data":"cc3363195494018c44df4d7c1b5527cf266fb3238a5829f3e0f75a14653d96d8"} Jul 20 15:58:53.085466 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.085425 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" podStartSLOduration=1.749301496 podStartE2EDuration="2.085410471s" totalImagesPullingTime="336.108975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:53.083393614 +0000 UTC m=+510.029849274" watchObservedRunningTime="2026-07-20 15:58:53.085410471 +0000 UTC m=+510.031866126" Jul 20 15:58:53.099553 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.099515 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54b6fdf78f-57s75" podStartSLOduration=1.7293864 podStartE2EDuration="2.099501172s" totalImagesPullingTime="370.114772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:53.098577114 +0000 UTC m=+510.045032782" watchObservedRunningTime="2026-07-20 15:58:53.099501172 +0000 UTC m=+510.045956827" Jul 20 15:58:53.126115 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.126085 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:53.126294 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.126262 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zpspm" podUID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" containerName="authorino" containerID="cri-o://a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76" gracePeriod=30 Jul 20 15:58:53.147640 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.147612 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6df49b6d77-xvxnp"] Jul 20 15:58:53.152241 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.152216 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6df49b6d77-xvxnp"] Jul 20 15:58:53.362393 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.362367 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:53.376187 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.376141 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6zft\" (UniqueName: \"kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft\") pod \"78dc68ff-6687-4d4b-9997-3af87f9e616f\" (UID: \"78dc68ff-6687-4d4b-9997-3af87f9e616f\") " Jul 20 15:58:53.378142 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.378112 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft" (OuterVolumeSpecName: "kube-api-access-q6zft") pod "78dc68ff-6687-4d4b-9997-3af87f9e616f" (UID: "78dc68ff-6687-4d4b-9997-3af87f9e616f"). InnerVolumeSpecName "kube-api-access-q6zft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:58:53.396818 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.396791 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:53.477481 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.477450 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7\") pod \"58cbc2a6-1cde-476d-960c-8ff8486a6d45\" (UID: \"58cbc2a6-1cde-476d-960c-8ff8486a6d45\") " Jul 20 15:58:53.477648 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.477625 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6zft\" (UniqueName: \"kubernetes.io/projected/78dc68ff-6687-4d4b-9997-3af87f9e616f-kube-api-access-q6zft\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:58:53.479529 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.479506 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7" (OuterVolumeSpecName: "kube-api-access-6vrz7") pod "58cbc2a6-1cde-476d-960c-8ff8486a6d45" (UID: "58cbc2a6-1cde-476d-960c-8ff8486a6d45"). InnerVolumeSpecName "kube-api-access-6vrz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 15:58:53.541874 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.541844 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a" path="/var/lib/kubelet/pods/1bb71d63-1ae1-4c9c-b2b7-298b3ad69d7a/volumes" Jul 20 15:58:53.578206 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:53.578149 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vrz7\" (UniqueName: \"kubernetes.io/projected/58cbc2a6-1cde-476d-960c-8ff8486a6d45-kube-api-access-6vrz7\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 15:58:54.075565 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.075533 2585 generic.go:356] "Generic (PLEG): container finished" podID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" containerID="a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76" exitCode=0 Jul 20 15:58:54.076030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.075598 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zpspm" Jul 20 15:58:54.076030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.075616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpspm" event={"ID":"58cbc2a6-1cde-476d-960c-8ff8486a6d45","Type":"ContainerDied","Data":"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76"} Jul 20 15:58:54.076030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.075658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zpspm" event={"ID":"58cbc2a6-1cde-476d-960c-8ff8486a6d45","Type":"ContainerDied","Data":"b00bfd85e8a2565f3e0629aa24ac938db502cfcf316638eb444dca549f35b24e"} Jul 20 15:58:54.076030 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.075681 2585 scope.go:117] "RemoveContainer" containerID="a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76" Jul 20 15:58:54.076975 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.076960 2585 generic.go:356] "Generic (PLEG): container finished" podID="78dc68ff-6687-4d4b-9997-3af87f9e616f" containerID="afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b" exitCode=0 Jul 20 15:58:54.077049 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.077028 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" Jul 20 15:58:54.077088 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.077049 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" event={"ID":"78dc68ff-6687-4d4b-9997-3af87f9e616f","Type":"ContainerDied","Data":"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b"} Jul 20 15:58:54.077123 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.077086 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bhc2m" event={"ID":"78dc68ff-6687-4d4b-9997-3af87f9e616f","Type":"ContainerDied","Data":"5662fb5114318aa0e0df7ca8a17321f4b2fbe77e05a64dd4d25c490ee0389205"} Jul 20 15:58:54.087819 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.087271 2585 scope.go:117] "RemoveContainer" containerID="a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76" Jul 20 15:58:54.087961 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:58:54.087867 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76\": container with ID starting with a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76 not found: ID does not exist" containerID="a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76" Jul 20 15:58:54.087961 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.087903 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76"} err="failed to get container status \"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76\": rpc error: code = NotFound desc = could not find container \"a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76\": container with ID starting with a82155f5513123fc38f3759e636eff33742466870555124622013be94a2b6e76 not found: ID does not exist" Jul 20 15:58:54.087961 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.087922 2585 scope.go:117] "RemoveContainer" containerID="afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b" Jul 20 15:58:54.093610 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.093578 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:54.095769 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.095748 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bhc2m"] Jul 20 15:58:54.097259 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.097237 2585 scope.go:117] "RemoveContainer" containerID="afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b" Jul 20 15:58:54.097524 ip-10-0-138-33 kubenswrapper[2585]: E0720 15:58:54.097507 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b\": container with ID starting with afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b not found: ID does not exist" containerID="afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b" Jul 20 15:58:54.097700 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.097532 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b"} err="failed to get container status \"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b\": rpc error: code = NotFound desc = could not find container \"afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b\": container with ID starting with afd66b9a7b1413ad46f4c9cad75dc61e02431f83c063c382fc2a25ccc87fcc9b not found: ID does not exist" Jul 20 15:58:54.106236 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.106213 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:54.110737 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:54.110718 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zpspm"] Jul 20 15:58:55.540836 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:55.540802 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" path="/var/lib/kubelet/pods/58cbc2a6-1cde-476d-960c-8ff8486a6d45/volumes" Jul 20 15:58:55.541229 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:58:55.541115 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78dc68ff-6687-4d4b-9997-3af87f9e616f" path="/var/lib/kubelet/pods/78dc68ff-6687-4d4b-9997-3af87f9e616f/volumes" Jul 20 15:59:34.908292 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:34.908259 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 15:59:43.347678 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.347643 2585 generic.go:356] "Generic (PLEG): container finished" podID="c2e9747c-5dd6-44c4-b1f1-4d59facfd449" containerID="980f2f7bd7699d554b4c5f199949ceaf239c71341944bbea8fa0d1c994f167f5" exitCode=0 Jul 20 15:59:43.348145 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.347715 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" event={"ID":"c2e9747c-5dd6-44c4-b1f1-4d59facfd449","Type":"ContainerDied","Data":"980f2f7bd7699d554b4c5f199949ceaf239c71341944bbea8fa0d1c994f167f5"} Jul 20 15:59:43.348145 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.348104 2585 scope.go:117] "RemoveContainer" containerID="980f2f7bd7699d554b4c5f199949ceaf239c71341944bbea8fa0d1c994f167f5" Jul 20 15:59:43.349137 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.349113 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:59:43.349213 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.349203 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:59:43.349250 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:43.349237 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 15:59:44.359353 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:44.359315 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" event={"ID":"c2e9747c-5dd6-44c4-b1f1-4d59facfd449","Type":"ContainerStarted","Data":"de02d47bef77acd48b2428ce205e25c0789dba6a60a663f9e061dfd2e357da4b"} Jul 20 15:59:45.085950 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:45.085909 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:59:45.087212 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:45.087183 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5t925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 15:59:45.087331 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:45.087235 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" podUID="c2e9747c-5dd6-44c4-b1f1-4d59facfd449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 15:59:46.086445 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:46.086407 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5t925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 15:59:46.086818 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:46.086463 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" podUID="c2e9747c-5dd6-44c4-b1f1-4d59facfd449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 15:59:46.861721 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:46.861683 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:59:47.086518 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:47.086480 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5t925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 15:59:47.086891 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:47.086537 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" podUID="c2e9747c-5dd6-44c4-b1f1-4d59facfd449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 15:59:48.086696 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:48.086659 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-5t925 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 20 15:59:48.087107 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:48.086716 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" podUID="c2e9747c-5dd6-44c4-b1f1-4d59facfd449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 20 15:59:49.089082 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:49.089052 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:59:49.090178 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:49.090143 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-5t925" Jul 20 15:59:53.309469 ip-10-0-138-33 kubenswrapper[2585]: I0720 15:59:53.309437 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:00:00.400623 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:00.400583 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:00:10.108410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:10.108367 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:00:16.663277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:16.663237 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:00:23.484546 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:23.484518 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:00:23.485018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:23.484927 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:00:23.490062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:23.490037 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:00:23.490228 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:23.490196 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:00:48.011344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:00:48.011262 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:01:00.310585 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:01:00.310537 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:02:13.373748 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.373709 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d65d7f4d-fr72g"] Jul 20 16:02:13.374183 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374094 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" containerName="authorino" Jul 20 16:02:13.374183 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374106 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" containerName="authorino" Jul 20 16:02:13.374183 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374119 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78dc68ff-6687-4d4b-9997-3af87f9e616f" containerName="authorino" Jul 20 16:02:13.374183 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374125 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="78dc68ff-6687-4d4b-9997-3af87f9e616f" containerName="authorino" Jul 20 16:02:13.374336 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374210 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="78dc68ff-6687-4d4b-9997-3af87f9e616f" containerName="authorino" Jul 20 16:02:13.374336 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.374222 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cbc2a6-1cde-476d-960c-8ff8486a6d45" containerName="authorino" Jul 20 16:02:13.376166 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.376138 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.388990 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.388964 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d65d7f4d-fr72g"] Jul 20 16:02:13.462135 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.462094 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-tls-cert\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.462327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.462187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cpmf\" (UniqueName: \"kubernetes.io/projected/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-kube-api-access-8cpmf\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.563483 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.563443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-tls-cert\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.563661 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.563507 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cpmf\" (UniqueName: \"kubernetes.io/projected/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-kube-api-access-8cpmf\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.565922 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.565898 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-tls-cert\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.572993 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.572960 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cpmf\" (UniqueName: \"kubernetes.io/projected/69ce1f3d-eed1-49f0-9d53-0b7a0c87c287-kube-api-access-8cpmf\") pod \"authorino-5d65d7f4d-fr72g\" (UID: \"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287\") " pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.684880 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.684844 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d65d7f4d-fr72g" Jul 20 16:02:13.834928 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.834900 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d65d7f4d-fr72g"] Jul 20 16:02:13.836686 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:02:13.836659 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69ce1f3d_eed1_49f0_9d53_0b7a0c87c287.slice/crio-327fa4402ff4e2a9790f5ebe8eb2890415ca45762cee59ff53667ad01605d131 WatchSource:0}: Error finding container 327fa4402ff4e2a9790f5ebe8eb2890415ca45762cee59ff53667ad01605d131: Status 404 returned error can't find the container with id 327fa4402ff4e2a9790f5ebe8eb2890415ca45762cee59ff53667ad01605d131 Jul 20 16:02:13.837926 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:13.837907 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:02:14.185125 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:14.185090 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d65d7f4d-fr72g" event={"ID":"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287","Type":"ContainerStarted","Data":"327fa4402ff4e2a9790f5ebe8eb2890415ca45762cee59ff53667ad01605d131"} Jul 20 16:02:15.194070 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.194028 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d65d7f4d-fr72g" event={"ID":"69ce1f3d-eed1-49f0-9d53-0b7a0c87c287","Type":"ContainerStarted","Data":"820dd616515ad9ca1eedbf486b47a8d203480a17eca490c525c7a4085ea3fc17"} Jul 20 16:02:15.217389 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.217336 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d65d7f4d-fr72g" podStartSLOduration=1.188934047 podStartE2EDuration="2.217320578s" totalImagesPullingTime="1.028386531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:02:15.21691812 +0000 UTC m=+712.163373776" watchObservedRunningTime="2026-07-20 16:02:15.217320578 +0000 UTC m=+712.163776232" Jul 20 16:02:15.268285 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.268250 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 16:02:15.268460 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.268443 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-54b6fdf78f-57s75" podUID="8d513170-bd19-46c7-ae41-126dacabd3f1" containerName="authorino" containerID="cri-o://4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6" gracePeriod=30 Jul 20 16:02:15.527092 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.527054 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 16:02:15.581411 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.581375 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert\") pod \"8d513170-bd19-46c7-ae41-126dacabd3f1\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " Jul 20 16:02:15.581598 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.581428 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww77t\" (UniqueName: \"kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t\") pod \"8d513170-bd19-46c7-ae41-126dacabd3f1\" (UID: \"8d513170-bd19-46c7-ae41-126dacabd3f1\") " Jul 20 16:02:15.583514 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.583479 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t" (OuterVolumeSpecName: "kube-api-access-ww77t") pod "8d513170-bd19-46c7-ae41-126dacabd3f1" (UID: "8d513170-bd19-46c7-ae41-126dacabd3f1"). InnerVolumeSpecName "kube-api-access-ww77t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:02:15.592448 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.592415 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8d513170-bd19-46c7-ae41-126dacabd3f1" (UID: "8d513170-bd19-46c7-ae41-126dacabd3f1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:02:15.682224 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.682185 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww77t\" (UniqueName: \"kubernetes.io/projected/8d513170-bd19-46c7-ae41-126dacabd3f1-kube-api-access-ww77t\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:02:15.682224 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:15.682219 2585 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d513170-bd19-46c7-ae41-126dacabd3f1-tls-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:02:16.201614 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.201579 2585 generic.go:356] "Generic (PLEG): container finished" podID="8d513170-bd19-46c7-ae41-126dacabd3f1" containerID="4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6" exitCode=0 Jul 20 16:02:16.201614 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.201626 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54b6fdf78f-57s75" Jul 20 16:02:16.202101 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.201658 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b6fdf78f-57s75" event={"ID":"8d513170-bd19-46c7-ae41-126dacabd3f1","Type":"ContainerDied","Data":"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6"} Jul 20 16:02:16.202101 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.201700 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54b6fdf78f-57s75" event={"ID":"8d513170-bd19-46c7-ae41-126dacabd3f1","Type":"ContainerDied","Data":"cc3363195494018c44df4d7c1b5527cf266fb3238a5829f3e0f75a14653d96d8"} Jul 20 16:02:16.202101 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.201722 2585 scope.go:117] "RemoveContainer" containerID="4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6" Jul 20 16:02:16.215225 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.215202 2585 scope.go:117] "RemoveContainer" containerID="4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6" Jul 20 16:02:16.215602 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:02:16.215578 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6\": container with ID starting with 4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6 not found: ID does not exist" containerID="4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6" Jul 20 16:02:16.215752 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.215720 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6"} err="failed to get container status \"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6\": rpc error: code = NotFound desc = could not find container \"4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6\": container with ID starting with 4b9c1441139847e163da7b46de9d040847791b41222a212db3558faff37bd3d6 not found: ID does not exist" Jul 20 16:02:16.242147 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.242099 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 16:02:16.245703 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:16.245672 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54b6fdf78f-57s75"] Jul 20 16:02:17.541854 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:17.541816 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d513170-bd19-46c7-ae41-126dacabd3f1" path="/var/lib/kubelet/pods/8d513170-bd19-46c7-ae41-126dacabd3f1/volumes" Jul 20 16:02:46.225662 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:46.225626 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:02:56.434020 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:02:56.433987 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:03:07.219301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:03:07.219261 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:04:47.324942 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:04:47.324898 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:04:57.434278 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:04:57.434244 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:05:23.519350 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:23.519276 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:05:23.520829 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:23.520808 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:05:23.525403 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:23.525382 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:05:23.526669 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:23.526651 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:05:34.001011 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:34.000966 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:05:44.095650 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:44.095610 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:05:53.317973 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:05:53.317939 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:06:04.302859 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:06:04.302815 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:06:16.099391 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:06:16.099351 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:06:28.112633 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:06:28.112590 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:06:38.600001 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:06:38.599962 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:06:48.501233 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:06:48.501110 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:07:11.209414 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:07:11.209380 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:07:23.603424 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:07:23.603386 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:07:45.602769 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:07:45.602731 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:07:56.799597 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:07:56.799558 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:08:13.410245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:08:13.410208 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:08:23.011961 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:08:23.011870 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:08:32.909636 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:08:32.909604 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:08:42.704018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:08:42.703979 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:08:52.107019 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:08:52.106973 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:09:16.544617 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:16.544366 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 16:09:16.545274 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:16.544654 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" podUID="0a0b26c1-6a42-48cb-9307-252196dc1a37" containerName="manager" containerID="cri-o://78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9" gracePeriod=10 Jul 20 16:09:19.307603 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.307571 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 16:09:19.429151 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.429061 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume\") pod \"0a0b26c1-6a42-48cb-9307-252196dc1a37\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " Jul 20 16:09:19.429151 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.429121 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-526vn\" (UniqueName: \"kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn\") pod \"0a0b26c1-6a42-48cb-9307-252196dc1a37\" (UID: \"0a0b26c1-6a42-48cb-9307-252196dc1a37\") " Jul 20 16:09:19.429486 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.429461 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a0b26c1-6a42-48cb-9307-252196dc1a37" (UID: "0a0b26c1-6a42-48cb-9307-252196dc1a37"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:09:19.431205 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.431178 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn" (OuterVolumeSpecName: "kube-api-access-526vn") pod "0a0b26c1-6a42-48cb-9307-252196dc1a37" (UID: "0a0b26c1-6a42-48cb-9307-252196dc1a37"). InnerVolumeSpecName "kube-api-access-526vn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:09:19.530695 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.530660 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a0b26c1-6a42-48cb-9307-252196dc1a37-extensions-socket-volume\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:09:19.530695 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.530690 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-526vn\" (UniqueName: \"kubernetes.io/projected/0a0b26c1-6a42-48cb-9307-252196dc1a37-kube-api-access-526vn\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:09:19.559800 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.559762 2585 generic.go:356] "Generic (PLEG): container finished" podID="0a0b26c1-6a42-48cb-9307-252196dc1a37" containerID="78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9" exitCode=0 Jul 20 16:09:19.559953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.559806 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" Jul 20 16:09:19.559953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.559858 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" event={"ID":"0a0b26c1-6a42-48cb-9307-252196dc1a37","Type":"ContainerDied","Data":"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9"} Jul 20 16:09:19.559953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.559912 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8" event={"ID":"0a0b26c1-6a42-48cb-9307-252196dc1a37","Type":"ContainerDied","Data":"425397dd476c3ad6e64a24c1e25945586af6ec6499a5780df43614502904e083"} Jul 20 16:09:19.559953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.559934 2585 scope.go:117] "RemoveContainer" containerID="78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9" Jul 20 16:09:19.569087 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.569069 2585 scope.go:117] "RemoveContainer" containerID="78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9" Jul 20 16:09:19.569398 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:09:19.569376 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9\": container with ID starting with 78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9 not found: ID does not exist" containerID="78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9" Jul 20 16:09:19.569481 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.569407 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9"} err="failed to get container status \"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9\": rpc error: code = NotFound desc = could not find container \"78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9\": container with ID starting with 78cfdf1b3375585b4d0c12b5619f121318bca5c464b9ecf48a3386a9e4befdc9 not found: ID does not exist" Jul 20 16:09:19.582817 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.582789 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 16:09:19.588284 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:19.588258 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-st8t8"] Jul 20 16:09:21.540807 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:09:21.540771 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a0b26c1-6a42-48cb-9307-252196dc1a37" path="/var/lib/kubelet/pods/0a0b26c1-6a42-48cb-9307-252196dc1a37/volumes" Jul 20 16:10:17.697875 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.697831 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz"] Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698365 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a0b26c1-6a42-48cb-9307-252196dc1a37" containerName="manager" Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698381 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a0b26c1-6a42-48cb-9307-252196dc1a37" containerName="manager" Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698409 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d513170-bd19-46c7-ae41-126dacabd3f1" containerName="authorino" Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698414 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d513170-bd19-46c7-ae41-126dacabd3f1" containerName="authorino" Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698473 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a0b26c1-6a42-48cb-9307-252196dc1a37" containerName="manager" Jul 20 16:10:17.700437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.698483 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d513170-bd19-46c7-ae41-126dacabd3f1" containerName="authorino" Jul 20 16:10:17.701428 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.701409 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.705434 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.705417 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ghj5c\"" Jul 20 16:10:17.718417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.718387 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz"] Jul 20 16:10:17.826362 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.826330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bff018-8562-40fd-af37-da52e759fb92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.826546 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.826385 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vl9h\" (UniqueName: \"kubernetes.io/projected/f7bff018-8562-40fd-af37-da52e759fb92-kube-api-access-6vl9h\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.927341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.927305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vl9h\" (UniqueName: \"kubernetes.io/projected/f7bff018-8562-40fd-af37-da52e759fb92-kube-api-access-6vl9h\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.927516 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.927411 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bff018-8562-40fd-af37-da52e759fb92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.927738 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.927722 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bff018-8562-40fd-af37-da52e759fb92-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:17.938902 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:17.938869 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vl9h\" (UniqueName: \"kubernetes.io/projected/f7bff018-8562-40fd-af37-da52e759fb92-kube-api-access-6vl9h\") pod \"kuadrant-operator-controller-manager-86878c769f-jgwpz\" (UID: \"f7bff018-8562-40fd-af37-da52e759fb92\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:18.011336 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.011238 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:18.156203 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.156174 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz"] Jul 20 16:10:18.157873 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:10:18.157842 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bff018_8562_40fd_af37_da52e759fb92.slice/crio-4c8d00b81a6644d5335fef60d4977c83a0c376698e588b6cb13f1819cbc207db WatchSource:0}: Error finding container 4c8d00b81a6644d5335fef60d4977c83a0c376698e588b6cb13f1819cbc207db: Status 404 returned error can't find the container with id 4c8d00b81a6644d5335fef60d4977c83a0c376698e588b6cb13f1819cbc207db Jul 20 16:10:18.874577 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.874535 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" event={"ID":"f7bff018-8562-40fd-af37-da52e759fb92","Type":"ContainerStarted","Data":"0d296ecb5015ed97cc143b678e12d2bebd2a2ebc864220b2e6c2894f54e7bbf0"} Jul 20 16:10:18.874962 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.874594 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" event={"ID":"f7bff018-8562-40fd-af37-da52e759fb92","Type":"ContainerStarted","Data":"4c8d00b81a6644d5335fef60d4977c83a0c376698e588b6cb13f1819cbc207db"} Jul 20 16:10:18.874962 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.874622 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:18.899262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:18.899210 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" podStartSLOduration=1.899195351 podStartE2EDuration="1.899195351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:18.897465183 +0000 UTC m=+1195.843920838" watchObservedRunningTime="2026-07-20 16:10:18.899195351 +0000 UTC m=+1195.845651006" Jul 20 16:10:23.555168 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:23.555125 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:10:23.560375 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:23.560353 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:10:23.561765 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:23.561743 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:10:23.567195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:23.567172 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:10:29.882806 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:29.882770 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jgwpz" Jul 20 16:10:37.613478 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:37.613437 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:10:49.702468 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:49.702428 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:10:58.659235 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:10:58.659193 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:11:13.361211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:11:13.361149 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:11:23.250560 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:11:23.250470 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:11:33.605699 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:11:33.605662 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:11:42.016707 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:11:42.016668 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:11:52.604008 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:11:52.603961 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:12:03.408792 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:12:03.408759 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:12:12.293355 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:12:12.293314 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:12:23.304781 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:12:23.300123 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:12:47.110168 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:12:47.110072 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:12:54.505879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:12:54.505836 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:13:17.706035 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:13:17.705999 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:13:31.402382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:13:31.402346 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:13:55.600225 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:13:55.600183 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:14:10.504430 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:14:10.504389 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:14:19.697630 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:14:19.697535 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:14:33.403068 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:14:33.403032 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:14:42.797502 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:14:42.797465 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:14:52.304356 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:14:52.304320 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:15:02.700013 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:02.699969 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:15:11.707608 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:11.707559 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:15:21.611832 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:21.611790 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:15:23.593116 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:23.593082 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:15:23.599060 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:23.599036 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:15:23.602349 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:23.602324 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:15:23.607780 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:23.607763 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:15:35.509381 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:35.509343 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:15:51.710052 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:15:51.709953 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:16:03.903973 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:16:03.903936 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:16:16.606429 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:16:16.606390 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:16:24.930216 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:16:24.930169 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:16:37.512452 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:16:37.512415 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:16:50.118167 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:16:50.118094 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:00.910610 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:00.910563 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:09.670833 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:09.670795 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:20.517459 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:20.517375 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:34.500873 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:34.500832 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:42.806230 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:42.806187 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:17:48.829199 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.829148 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:17:48.833012 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.832994 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.836727 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.836706 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eaab05e4-openshift-default-dockercfg-drm7p\"" Jul 20 16:17:48.859718 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.859680 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:17:48.888594 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpnhw\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888617 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888636 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888675 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888692 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888746 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888964 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888766 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.888964 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.888788 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990224 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990181 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990287 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpnhw\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990379 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990402 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990418 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990850 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990629 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990850 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990837 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.990953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990920 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.991009 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.990959 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.991274 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.991255 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.992639 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.992605 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.992893 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.992872 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.998836 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.998809 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:48.999453 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:48.999433 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpnhw\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw\") pod \"e2e-ait-eaab05e4-openshift-default-796594755c-kngzq\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:49.144015 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.143919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:49.286387 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.286360 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:17:49.288108 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:17:49.288073 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9938f0_63e9_4c1d_8437_44d68dec219b.slice/crio-a10120e58ba45c61e2d40913ffe878123d7bac7f2a512a7444c035b81712ee20 WatchSource:0}: Error finding container a10120e58ba45c61e2d40913ffe878123d7bac7f2a512a7444c035b81712ee20: Status 404 returned error can't find the container with id a10120e58ba45c61e2d40913ffe878123d7bac7f2a512a7444c035b81712ee20 Jul 20 16:17:49.290343 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.290311 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:17:49.290419 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.290378 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:17:49.290419 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.290411 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:17:49.368738 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.368702 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerStarted","Data":"ee183a0fe0dd9c54b4d203d17372fc4c082637033b7e882ba77a195cf69c52fc"} Jul 20 16:17:49.368917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.368763 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerStarted","Data":"a10120e58ba45c61e2d40913ffe878123d7bac7f2a512a7444c035b81712ee20"} Jul 20 16:17:49.390968 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:49.390911 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podStartSLOduration=1.390889411 podStartE2EDuration="1.390889411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:17:49.389426741 +0000 UTC m=+1646.335882398" watchObservedRunningTime="2026-07-20 16:17:49.390889411 +0000 UTC m=+1646.337345066" Jul 20 16:17:50.144280 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:50.144228 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:50.149332 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:50.149303 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:50.374451 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:50.374422 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:50.375342 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:50.375323 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:17:54.111901 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:17:54.111845 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:18:02.449136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.449101 2585 generic.go:356] "Generic (PLEG): container finished" podID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerID="ee183a0fe0dd9c54b4d203d17372fc4c082637033b7e882ba77a195cf69c52fc" exitCode=0 Jul 20 16:18:02.449136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.449138 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerDied","Data":"ee183a0fe0dd9c54b4d203d17372fc4c082637033b7e882ba77a195cf69c52fc"} Jul 20 16:18:02.449595 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.449534 2585 scope.go:117] "RemoveContainer" containerID="ee183a0fe0dd9c54b4d203d17372fc4c082637033b7e882ba77a195cf69c52fc" Jul 20 16:18:02.450566 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.450535 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:02.450627 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.450616 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:02.450678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:02.450662 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:03.460614 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:03.460575 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerStarted","Data":"358d2ceb230e4d1197576d031c59502ba312d53f91da0c21b54799b3cf6fa578"} Jul 20 16:18:04.145701 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:04.145658 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:04.145913 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:04.145790 2585 patch_prober.go:28] interesting pod/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:18:04.145913 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:04.145859 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:18:05.144523 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:05.144476 2585 patch_prober.go:28] interesting pod/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:18:05.145056 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:05.144548 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:18:05.375256 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:05.375214 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:06.144720 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:06.144669 2585 patch_prober.go:28] interesting pod/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:18:06.145262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:06.144743 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:18:07.144552 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:07.144513 2585 patch_prober.go:28] interesting pod/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 20 16:18:07.144841 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:07.144809 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 20 16:18:08.148891 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:08.148859 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:08.150061 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:08.150036 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:28.494390 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:28.494358 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:18:31.521678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:31.521636 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:18:31.522077 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:31.521907 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" containerID="cri-o://358d2ceb230e4d1197576d031c59502ba312d53f91da0c21b54799b3cf6fa578" gracePeriod=30 Jul 20 16:18:32.514628 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.514589 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:18:32.517041 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.517025 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.521688 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.521668 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e0afadbb-gw-openshift-default-dockercfg-vt7l5\"" Jul 20 16:18:32.536341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.536318 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:18:32.590365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590328 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590576 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590488 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590576 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590536 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590576 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590573 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590756 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590644 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590756 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590756 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590730 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590903 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.590903 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.590778 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clz4t\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.691997 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692048 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692076 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692105 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692175 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692265 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692341 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692288 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clz4t\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692671 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692735 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692672 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692790 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692770 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692842 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692799 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.692898 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.692881 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.694480 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.694458 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.694608 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.694592 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.700504 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.700485 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clz4t\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.700803 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.700788 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token\") pod \"e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.827134 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.827040 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:32.965376 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.965338 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:18:32.966773 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:18:32.966747 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf32e33a_32ad_4c41_8a7a_de0122402752.slice/crio-9c9b7fbd511f60ad8c1a4426ddd77c3b267619e423e51bcefdebd9f972ec4715 WatchSource:0}: Error finding container 9c9b7fbd511f60ad8c1a4426ddd77c3b267619e423e51bcefdebd9f972ec4715: Status 404 returned error can't find the container with id 9c9b7fbd511f60ad8c1a4426ddd77c3b267619e423e51bcefdebd9f972ec4715 Jul 20 16:18:32.969516 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.969484 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:32.969619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.969557 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:32.969619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:32.969588 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:33.624029 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:33.623988 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerStarted","Data":"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee"} Jul 20 16:18:33.624440 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:33.624046 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerStarted","Data":"9c9b7fbd511f60ad8c1a4426ddd77c3b267619e423e51bcefdebd9f972ec4715"} Jul 20 16:18:33.645783 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:33.645723 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podStartSLOduration=1.6457026479999999 podStartE2EDuration="1.645702648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:18:33.642433976 +0000 UTC m=+1690.588889632" watchObservedRunningTime="2026-07-20 16:18:33.645702648 +0000 UTC m=+1690.592158306" Jul 20 16:18:33.828177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:33.828134 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:34.832928 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:34.832895 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:35.636219 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:35.636188 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:35.637212 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:35.637193 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:36.643482 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.643449 2585 generic.go:356] "Generic (PLEG): container finished" podID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerID="358d2ceb230e4d1197576d031c59502ba312d53f91da0c21b54799b3cf6fa578" exitCode=0 Jul 20 16:18:36.643893 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.643527 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerDied","Data":"358d2ceb230e4d1197576d031c59502ba312d53f91da0c21b54799b3cf6fa578"} Jul 20 16:18:36.643893 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.643603 2585 scope.go:117] "RemoveContainer" containerID="ee183a0fe0dd9c54b4d203d17372fc4c082637033b7e882ba77a195cf69c52fc" Jul 20 16:18:36.776477 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.776449 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:36.831627 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831542 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831627 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831594 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831640 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831663 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831735 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831757 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831794 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.831849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831825 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpnhw\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.832170 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831856 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket\") pod \"9c9938f0-63e9-4c1d-8437-44d68dec219b\" (UID: \"9c9938f0-63e9-4c1d-8437-44d68dec219b\") " Jul 20 16:18:36.832170 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.831953 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:36.832283 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.832200 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:36.832283 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.832220 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.832556 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.832442 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:36.832556 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.832480 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:18:36.832746 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.832721 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:36.834253 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.834007 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:36.834365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.834294 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:18:36.834636 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.834612 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:18:36.834729 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.834678 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw" (OuterVolumeSpecName: "kube-api-access-gpnhw") pod "9c9938f0-63e9-4c1d-8437-44d68dec219b" (UID: "9c9938f0-63e9-4c1d-8437-44d68dec219b"). InnerVolumeSpecName "kube-api-access-gpnhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:18:36.933200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933126 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933197 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933207 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933214 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933488 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933222 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933488 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933232 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c9938f0-63e9-4c1d-8437-44d68dec219b-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933488 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933242 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpnhw\" (UniqueName: \"kubernetes.io/projected/9c9938f0-63e9-4c1d-8437-44d68dec219b-kube-api-access-gpnhw\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:36.933488 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:36.933251 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c9938f0-63e9-4c1d-8437-44d68dec219b-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:18:37.649828 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:37.649790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" event={"ID":"9c9938f0-63e9-4c1d-8437-44d68dec219b","Type":"ContainerDied","Data":"a10120e58ba45c61e2d40913ffe878123d7bac7f2a512a7444c035b81712ee20"} Jul 20 16:18:37.650344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:37.649854 2585 scope.go:117] "RemoveContainer" containerID="358d2ceb230e4d1197576d031c59502ba312d53f91da0c21b54799b3cf6fa578" Jul 20 16:18:37.650344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:37.649804 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq" Jul 20 16:18:37.670399 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:37.670372 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:18:37.676346 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:37.676323 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eaab05e4-openshift-default-796594755c-kngzq"] Jul 20 16:18:39.541508 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:39.541471 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" path="/var/lib/kubelet/pods/9c9938f0-63e9-4c1d-8437-44d68dec219b/volumes" Jul 20 16:18:39.999065 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:39.999028 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:18:48.710322 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.710288 2585 generic.go:356] "Generic (PLEG): container finished" podID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerID="2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee" exitCode=0 Jul 20 16:18:48.710751 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.710376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerDied","Data":"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee"} Jul 20 16:18:48.710799 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.710779 2585 scope.go:117] "RemoveContainer" containerID="2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee" Jul 20 16:18:48.711803 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.711780 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:48.711854 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.711843 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:48.711900 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:48.711874 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:18:49.717865 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:49.717832 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerStarted","Data":"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0"} Jul 20 16:18:49.828072 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:49.828021 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:49.829078 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:49.829052 2585 patch_prober.go:28] interesting pod/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:18:49.829233 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:49.829109 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:18:50.636893 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:50.636855 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:50.827923 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:50.827891 2585 patch_prober.go:28] interesting pod/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:18:50.828332 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:50.827939 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:18:51.828183 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:51.828125 2585 patch_prober.go:28] interesting pod/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:18:51.828560 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:51.828198 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:18:52.828188 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:52.828132 2585 patch_prober.go:28] interesting pod/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 20 16:18:52.828577 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:52.828209 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 20 16:18:53.831890 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:53.831859 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:18:53.834189 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:18:53.833239 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:19:13.706495 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:13.706464 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:19:15.301946 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:15.301911 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:19:15.302370 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:15.302204 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" containerID="cri-o://c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0" gracePeriod=30 Jul 20 16:19:16.068531 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068501 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:19:16.068883 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068869 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:19:16.068929 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068887 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:19:16.068929 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068898 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:19:16.068929 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068903 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:19:16.069023 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.068980 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:19:16.072012 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.071996 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.074399 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.074375 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-babce7f9-openshift-default-dockercfg-zwnd2\"" Jul 20 16:19:16.082338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.082318 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:19:16.096532 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096504 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096649 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096543 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096649 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096569 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096649 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096605 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096764 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096653 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096764 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096698 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096841 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096770 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxws4\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096841 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.096911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.096858 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197339 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197306 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197515 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxws4\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197515 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197415 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197515 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197461 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197564 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197587 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.197678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.197657 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.198391 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.198303 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.198538 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.198515 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.198608 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.198557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.198670 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.198625 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.198729 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.198712 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.199941 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.199919 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.200038 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.200022 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.207783 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.207761 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.208355 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.208331 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxws4\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4\") pod \"e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.383022 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.382935 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:16.524890 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.524858 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:19:16.526586 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:19:16.526555 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c1ad79_f18f_4d5b_8e5c_23850302bf4b.slice/crio-925f20f68e6b1f7093aa6ab6ad0c19bee71e12dbe962046d10fd371d57788cf7 WatchSource:0}: Error finding container 925f20f68e6b1f7093aa6ab6ad0c19bee71e12dbe962046d10fd371d57788cf7: Status 404 returned error can't find the container with id 925f20f68e6b1f7093aa6ab6ad0c19bee71e12dbe962046d10fd371d57788cf7 Jul 20 16:19:16.528569 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.528541 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:16.528673 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.528603 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:16.528673 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.528634 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:16.874750 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.874708 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerStarted","Data":"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0"} Jul 20 16:19:16.874945 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.874805 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerStarted","Data":"925f20f68e6b1f7093aa6ab6ad0c19bee71e12dbe962046d10fd371d57788cf7"} Jul 20 16:19:16.896228 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:16.896178 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podStartSLOduration=0.896148871 podStartE2EDuration="896.148871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:16.894333734 +0000 UTC m=+1733.840789384" watchObservedRunningTime="2026-07-20 16:19:16.896148871 +0000 UTC m=+1733.842604527" Jul 20 16:19:17.383589 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:17.383551 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:17.388637 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:17.388611 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:17.880419 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:17.880386 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:17.881844 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:17.881821 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:20.571922 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.571863 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:19:20.636136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636101 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636394 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636146 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636394 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636234 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636394 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636259 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636394 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636283 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636622 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636415 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:19:20.636622 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636449 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636622 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636487 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636622 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636510 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.636818 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636729 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:19:20.636818 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636745 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:19:20.636818 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636764 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:19:20.636818 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.636779 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clz4t\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t\") pod \"bf32e33a-32ad-4c41-8a7a-de0122402752\" (UID: \"bf32e33a-32ad-4c41-8a7a-de0122402752\") " Jul 20 16:19:20.637149 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.637113 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.637149 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.637127 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:19:20.637303 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.637139 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf32e33a-32ad-4c41-8a7a-de0122402752-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.637303 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.637200 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.637303 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.637217 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.638441 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.638418 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:19:20.638709 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.638685 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:19:20.638775 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.638692 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:19:20.638928 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.638911 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t" (OuterVolumeSpecName: "kube-api-access-clz4t") pod "bf32e33a-32ad-4c41-8a7a-de0122402752" (UID: "bf32e33a-32ad-4c41-8a7a-de0122402752"). InnerVolumeSpecName "kube-api-access-clz4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:19:20.738039 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.738007 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.738039 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.738034 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.738039 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.738044 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.738320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.738052 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clz4t\" (UniqueName: \"kubernetes.io/projected/bf32e33a-32ad-4c41-8a7a-de0122402752-kube-api-access-clz4t\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.738320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.738062 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf32e33a-32ad-4c41-8a7a-de0122402752-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:19:20.898379 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.898288 2585 generic.go:356] "Generic (PLEG): container finished" podID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerID="c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0" exitCode=0 Jul 20 16:19:20.898379 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.898327 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" Jul 20 16:19:20.898379 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.898335 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerDied","Data":"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0"} Jul 20 16:19:20.898636 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.898409 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd" event={"ID":"bf32e33a-32ad-4c41-8a7a-de0122402752","Type":"ContainerDied","Data":"9c9b7fbd511f60ad8c1a4426ddd77c3b267619e423e51bcefdebd9f972ec4715"} Jul 20 16:19:20.898636 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.898436 2585 scope.go:117] "RemoveContainer" containerID="c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0" Jul 20 16:19:20.908774 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.908761 2585 scope.go:117] "RemoveContainer" containerID="2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee" Jul 20 16:19:20.916862 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.916845 2585 scope.go:117] "RemoveContainer" containerID="c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0" Jul 20 16:19:20.917118 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:19:20.917100 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0\": container with ID starting with c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0 not found: ID does not exist" containerID="c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0" Jul 20 16:19:20.917284 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.917128 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0"} err="failed to get container status \"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0\": rpc error: code = NotFound desc = could not find container \"c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0\": container with ID starting with c0d7909bc4e6ae41f9089affa22c7de110c96f55c0df6d298a6d6b7181b00ad0 not found: ID does not exist" Jul 20 16:19:20.917284 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.917147 2585 scope.go:117] "RemoveContainer" containerID="2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee" Jul 20 16:19:20.917406 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:19:20.917387 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee\": container with ID starting with 2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee not found: ID does not exist" containerID="2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee" Jul 20 16:19:20.917444 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.917413 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee"} err="failed to get container status \"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee\": rpc error: code = NotFound desc = could not find container \"2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee\": container with ID starting with 2c194f3237b760b16c726b113bf00be32931b88991ada8a21d93da0d7b0dc9ee not found: ID does not exist" Jul 20 16:19:20.921544 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.921522 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:19:20.925201 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:20.925179 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e0afadbb-gw-openshift-default-65894c64c-hf4bd"] Jul 20 16:19:21.542030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:21.541992 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" path="/var/lib/kubelet/pods/bf32e33a-32ad-4c41-8a7a-de0122402752/volumes" Jul 20 16:19:25.901763 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:25.901726 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:19:33.922331 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.922291 2585 patch_prober.go:28] interesting pod/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:19:33.923531 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.922371 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:19:33.981612 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.981581 2585 generic.go:356] "Generic (PLEG): container finished" podID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerID="cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0" exitCode=0 Jul 20 16:19:33.981736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.981648 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerDied","Data":"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0"} Jul 20 16:19:33.982040 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.982026 2585 scope.go:117] "RemoveContainer" containerID="cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0" Jul 20 16:19:33.983086 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.983058 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:33.983188 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.983136 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:33.983243 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:33.983206 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:19:34.988581 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:34.988546 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerStarted","Data":"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b"} Jul 20 16:19:35.384127 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:35.384040 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:35.384303 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:35.384280 2585 patch_prober.go:28] interesting pod/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:19:35.384358 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:35.384334 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:19:36.383895 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:36.383851 2585 patch_prober.go:28] interesting pod/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:19:36.384445 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:36.383932 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:19:37.383510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:37.383474 2585 patch_prober.go:28] interesting pod/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:19:37.383682 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:37.383529 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:19:38.383692 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:38.383652 2585 patch_prober.go:28] interesting pod/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 20 16:19:38.384095 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:38.383709 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 20 16:19:39.387671 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:39.387634 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:39.388037 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:39.387906 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:39.388735 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:39.388718 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:19:57.604532 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:19:57.604489 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:20:00.306200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:00.306141 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:20:00.306636 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:00.306400 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" containerID="cri-o://008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b" gracePeriod=30 Jul 20 16:20:01.188348 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188312 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188674 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188685 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188699 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188705 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188771 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188783 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf32e33a-32ad-4c41-8a7a-de0122402752" containerName="istio-proxy" Jul 20 16:20:01.188839 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.188790 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9938f0-63e9-4c1d-8437-44d68dec219b" containerName="istio-proxy" Jul 20 16:20:01.191744 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.191726 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.194448 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.194426 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-6679b04f-openshift-default-dockercfg-jmvhk\"" Jul 20 16:20:01.204121 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.204092 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:01.310743 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.310708 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.310781 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.310849 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.310883 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.310901 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.311009 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.311034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg42t\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.311056 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.311177 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.311075 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412142 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412101 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412142 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412140 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg42t\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412434 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412327 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412434 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412434 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412376 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412442 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412508 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412509 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412533 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412851 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412909 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412854 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.412909 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.412856 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.413217 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.413199 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.414751 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.414729 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.414953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.414936 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.420319 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.420296 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.420511 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.420491 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg42t\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t\") pod \"e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.503196 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.503098 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:01.644680 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.644654 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:01.646276 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:20:01.646246 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7072519b_7023_4f60_9abc_9424bc0cfe4a.slice/crio-9cef85fa45a141cb13ba6ae9648b8460ffc0b4180a1fe4a8cb8c836998b076e6 WatchSource:0}: Error finding container 9cef85fa45a141cb13ba6ae9648b8460ffc0b4180a1fe4a8cb8c836998b076e6: Status 404 returned error can't find the container with id 9cef85fa45a141cb13ba6ae9648b8460ffc0b4180a1fe4a8cb8c836998b076e6 Jul 20 16:20:01.648346 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.648317 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:01.648442 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.648392 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:01.648505 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:01.648440 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:02.135123 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:02.135067 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerStarted","Data":"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d"} Jul 20 16:20:02.135318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:02.135140 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerStarted","Data":"9cef85fa45a141cb13ba6ae9648b8460ffc0b4180a1fe4a8cb8c836998b076e6"} Jul 20 16:20:02.157813 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:02.157754 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podStartSLOduration=1.157738216 podStartE2EDuration="1.157738216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:20:02.154719352 +0000 UTC m=+1779.101175018" watchObservedRunningTime="2026-07-20 16:20:02.157738216 +0000 UTC m=+1779.104193870" Jul 20 16:20:02.503861 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:02.503822 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:02.508766 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:02.508741 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:03.148258 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:03.148222 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:03.149459 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:03.149434 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:05.581976 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.581904 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:20:05.757714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757685 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxws4\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757755 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757782 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757798 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757842 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757888 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.757915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757918 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.758270 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757966 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.758270 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.757994 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert\") pod \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\" (UID: \"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b\") " Jul 20 16:20:05.758270 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758118 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:05.758270 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758134 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:05.758270 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758123 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:05.758524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758367 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.758524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758391 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.758524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758405 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.758524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758447 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:20:05.758912 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.758881 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:05.760060 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.760035 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4" (OuterVolumeSpecName: "kube-api-access-kxws4") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "kube-api-access-kxws4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:05.760219 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.760200 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:05.760272 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.760226 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:05.760362 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.760347 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" (UID: "f4c1ad79-f18f-4d5b-8e5c-23850302bf4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859457 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859488 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859497 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxws4\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-kube-api-access-kxws4\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859507 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859516 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:05.859541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:05.859524 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:06.166595 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.166510 2585 generic.go:356] "Generic (PLEG): container finished" podID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerID="008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b" exitCode=0 Jul 20 16:20:06.166595 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.166568 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" Jul 20 16:20:06.166835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.166593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerDied","Data":"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b"} Jul 20 16:20:06.166835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.166646 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn" event={"ID":"f4c1ad79-f18f-4d5b-8e5c-23850302bf4b","Type":"ContainerDied","Data":"925f20f68e6b1f7093aa6ab6ad0c19bee71e12dbe962046d10fd371d57788cf7"} Jul 20 16:20:06.166835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.166669 2585 scope.go:117] "RemoveContainer" containerID="008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b" Jul 20 16:20:06.176672 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.176656 2585 scope.go:117] "RemoveContainer" containerID="cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0" Jul 20 16:20:06.185130 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.185109 2585 scope.go:117] "RemoveContainer" containerID="008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b" Jul 20 16:20:06.185420 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:20:06.185402 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b\": container with ID starting with 008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b not found: ID does not exist" containerID="008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b" Jul 20 16:20:06.185466 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.185429 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b"} err="failed to get container status \"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b\": rpc error: code = NotFound desc = could not find container \"008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b\": container with ID starting with 008be0c8922b0d0f1c8732d0a798bf938784e55271312a3f5b556368e446d58b not found: ID does not exist" Jul 20 16:20:06.185466 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.185447 2585 scope.go:117] "RemoveContainer" containerID="cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0" Jul 20 16:20:06.185705 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:20:06.185687 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0\": container with ID starting with cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0 not found: ID does not exist" containerID="cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0" Jul 20 16:20:06.185749 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.185712 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0"} err="failed to get container status \"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0\": rpc error: code = NotFound desc = could not find container \"cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0\": container with ID starting with cee39840a5c5b1c3f53c51e86611e19c54822297d5e75d524fbe65c00b2381e0 not found: ID does not exist" Jul 20 16:20:06.191307 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.191287 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:20:06.195700 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:06.195674 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-babce7f9-openshift-default-6b7b79b4f-kdwcn"] Jul 20 16:20:07.541071 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:07.541037 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" path="/var/lib/kubelet/pods/f4c1ad79-f18f-4d5b-8e5c-23850302bf4b/volumes" Jul 20 16:20:10.299592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:10.299555 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:20:18.149811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.149719 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:18.149811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.149795 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:18.238335 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.238250 2585 generic.go:356] "Generic (PLEG): container finished" podID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerID="a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d" exitCode=0 Jul 20 16:20:18.238335 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.238311 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerDied","Data":"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d"} Jul 20 16:20:18.238687 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.238672 2585 scope.go:117] "RemoveContainer" containerID="a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d" Jul 20 16:20:18.239735 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.239706 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:18.239846 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.239785 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:18.239846 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:18.239835 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:20:19.246417 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:19.246383 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerStarted","Data":"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab"} Jul 20 16:20:19.503307 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:19.503211 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:19.503598 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:19.503575 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:19.503649 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:19.503626 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:20.503486 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:20.503452 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:20.503915 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:20.503506 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:21.504052 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:21.504018 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:21.504471 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:21.504081 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:22.504041 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:22.503993 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:22.504284 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:22.504061 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:23.503906 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.503863 2585 patch_prober.go:28] interesting pod/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 20 16:20:23.504091 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.503926 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 20 16:20:23.629280 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.629248 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:20:23.634776 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.634749 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:20:23.664851 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.664821 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:20:23.671492 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:23.671466 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:20:24.506876 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:24.506847 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:24.507140 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:24.507119 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:24.507868 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:24.507850 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:42.199616 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:42.199570 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:20:43.607327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:43.607290 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:43.607912 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:43.607549 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" containerID="cri-o://de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab" gracePeriod=30 Jul 20 16:20:48.864595 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.864565 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:48.927014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.926925 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.926969 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927012 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927042 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927060 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927115 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927146 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927201 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg42t\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927253 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs\") pod \"7072519b-7023-4f60-9abc-9424bc0cfe4a\" (UID: \"7072519b-7023-4f60-9abc-9424bc0cfe4a\") " Jul 20 16:20:48.927382 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927248 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:48.927754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927453 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:48.927754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927529 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:48.927754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927546 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:48.927754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927648 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:48.927958 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.927795 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:20:48.928073 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.928046 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:48.929527 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.929497 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t" (OuterVolumeSpecName: "kube-api-access-jg42t") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "kube-api-access-jg42t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:48.929613 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.929526 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:20:48.929779 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.929759 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:20:48.929826 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:48.929804 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7072519b-7023-4f60-9abc-9424bc0cfe4a" (UID: "7072519b-7023-4f60-9abc-9424bc0cfe4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:20:49.028553 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028517 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028553 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028548 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7072519b-7023-4f60-9abc-9424bc0cfe4a-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028553 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028562 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg42t\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-kube-api-access-jg42t\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028794 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028575 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028794 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028587 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028794 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028598 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.028794 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.028608 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7072519b-7023-4f60-9abc-9424bc0cfe4a-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:20:49.421946 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.421912 2585 generic.go:356] "Generic (PLEG): container finished" podID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerID="de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab" exitCode=0 Jul 20 16:20:49.422275 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.421956 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" Jul 20 16:20:49.422275 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.421972 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerDied","Data":"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab"} Jul 20 16:20:49.422275 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.422026 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5" event={"ID":"7072519b-7023-4f60-9abc-9424bc0cfe4a","Type":"ContainerDied","Data":"9cef85fa45a141cb13ba6ae9648b8460ffc0b4180a1fe4a8cb8c836998b076e6"} Jul 20 16:20:49.422275 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.422055 2585 scope.go:117] "RemoveContainer" containerID="de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab" Jul 20 16:20:49.432030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.432004 2585 scope.go:117] "RemoveContainer" containerID="a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d" Jul 20 16:20:49.446363 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.446331 2585 scope.go:117] "RemoveContainer" containerID="de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab" Jul 20 16:20:49.446701 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:20:49.446674 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab\": container with ID starting with de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab not found: ID does not exist" containerID="de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab" Jul 20 16:20:49.446831 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.446711 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab"} err="failed to get container status \"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab\": rpc error: code = NotFound desc = could not find container \"de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab\": container with ID starting with de890a35d5973dc04217f17710f15107a50c4c3e82bdd9608f99623ab42f16ab not found: ID does not exist" Jul 20 16:20:49.446831 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.446737 2585 scope.go:117] "RemoveContainer" containerID="a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d" Jul 20 16:20:49.447223 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:20:49.447134 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d\": container with ID starting with a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d not found: ID does not exist" containerID="a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d" Jul 20 16:20:49.447223 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.447183 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d"} err="failed to get container status \"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d\": rpc error: code = NotFound desc = could not find container \"a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d\": container with ID starting with a6661459b23ac2fcebf082fd0d99a125c32911fa3912283c609d3f2cd4eb512d not found: ID does not exist" Jul 20 16:20:49.451542 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.451513 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:49.455166 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.455129 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-6679b04f-openshift-default-569c6dc775-ljzx5"] Jul 20 16:20:49.541013 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:20:49.540975 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" path="/var/lib/kubelet/pods/7072519b-7023-4f60-9abc-9424bc0cfe4a/volumes" Jul 20 16:22:09.911679 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:09.911593 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:22:21.108609 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:21.108572 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:22:22.101678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.101640 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:22:22.102125 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102104 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:22:22.102125 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102125 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102137 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102143 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102171 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102178 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102243 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102252 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:22:22.102321 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.102259 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:22:22.105456 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.105434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.108479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.108456 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0df208ce-openshift-default-dockercfg-xx9xw\"" Jul 20 16:22:22.131954 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.131917 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:22:22.151721 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.151911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151761 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8lz\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.151911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151803 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.151911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151850 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.151911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151875 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.152260 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151943 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.152260 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.151995 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.152260 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.152017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.152260 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.152070 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253192 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253131 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253208 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8lz\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253275 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253386 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253727 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253412 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253727 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253473 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253727 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253651 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.253899 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.253851 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.254133 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.254100 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.254418 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.254392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.254847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.254824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.256983 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.256962 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.257259 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.257237 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.262550 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.262525 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.262804 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.262787 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8lz\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz\") pod \"e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.419489 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.419400 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:22.572513 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.572482 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:22:22.574747 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:22:22.574684 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafddc30a_a614_4eec_b404_0eacaa3cda53.slice/crio-506661ba3b766377bdb8d6c2e017d0ee0546e6334e31b1701714f5350c60326f WatchSource:0}: Error finding container 506661ba3b766377bdb8d6c2e017d0ee0546e6334e31b1701714f5350c60326f: Status 404 returned error can't find the container with id 506661ba3b766377bdb8d6c2e017d0ee0546e6334e31b1701714f5350c60326f Jul 20 16:22:22.577535 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.577503 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:22.577621 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.577583 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:22.577666 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.577621 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:22.948279 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.948237 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerStarted","Data":"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59"} Jul 20 16:22:22.948486 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.948295 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerStarted","Data":"506661ba3b766377bdb8d6c2e017d0ee0546e6334e31b1701714f5350c60326f"} Jul 20 16:22:22.982653 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:22.982601 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podStartSLOduration=0.982584387 podStartE2EDuration="982.584387ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:22:22.979815104 +0000 UTC m=+1919.926270763" watchObservedRunningTime="2026-07-20 16:22:22.982584387 +0000 UTC m=+1919.929040042" Jul 20 16:22:23.419817 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:23.419727 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:23.424758 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:23.424727 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:23.954213 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:23.954178 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:23.955380 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:23.955349 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:33.716095 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:33.716064 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:22:39.995422 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:39.995372 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:22:39.995894 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:39.995457 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:22:42.061762 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.061730 2585 generic.go:356] "Generic (PLEG): container finished" podID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerID="9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59" exitCode=0 Jul 20 16:22:42.062316 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.061811 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerDied","Data":"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59"} Jul 20 16:22:42.062389 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.062354 2585 scope.go:117] "RemoveContainer" containerID="9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59" Jul 20 16:22:42.063378 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.063351 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:42.063442 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.063424 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:42.063478 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:42.063458 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:22:43.072089 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:43.072056 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerStarted","Data":"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501"} Jul 20 16:22:43.420600 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:43.420493 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:43.420763 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:43.420741 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:22:43.420812 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:43.420784 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:22:44.420102 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:44.420065 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:22:44.420539 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:44.420123 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:22:45.420038 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:45.419997 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:22:45.420264 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:45.420058 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:22:46.420502 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:46.420462 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 20 16:22:46.420985 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:46.420527 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 20 16:22:47.424142 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:47.424103 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:47.424577 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:47.424411 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:47.425236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:47.425215 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:22:50.397330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:50.397296 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:22:58.496079 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:58.496040 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:22:58.496543 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:22:58.496315 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" containerID="cri-o://b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501" gracePeriod=30 Jul 20 16:23:02.426939 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:02.426901 2585 patch_prober.go:28] interesting pod/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 20 16:23:02.427363 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:02.426971 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:23:03.759687 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.759613 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:23:03.825966 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.825935 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.825966 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.825969 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.825988 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826013 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826040 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826063 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826106 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826215 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8lz\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826248 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data\") pod \"afddc30a-a614-4eec-b404-0eacaa3cda53\" (UID: \"afddc30a-a614-4eec-b404-0eacaa3cda53\") " Jul 20 16:23:03.826619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826347 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:23:03.826619 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826438 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:23:03.826715 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826616 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afddc30a-a614-4eec-b404-0eacaa3cda53-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.826715 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826593 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:23:03.826715 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826635 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.826715 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.826697 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:23:03.827345 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.827321 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data" (OuterVolumeSpecName: "istio-data") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:23:03.828310 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.828285 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:23:03.828446 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.828396 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token" (OuterVolumeSpecName: "istio-token") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:23:03.828685 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.828665 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz" (OuterVolumeSpecName: "kube-api-access-bw8lz") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "kube-api-access-bw8lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:23:03.828770 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.828665 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afddc30a-a614-4eec-b404-0eacaa3cda53" (UID: "afddc30a-a614-4eec-b404-0eacaa3cda53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:23:03.927473 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927439 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8lz\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-kube-api-access-bw8lz\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927473 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927469 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927473 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927478 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927486 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927495 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927502 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afddc30a-a614-4eec-b404-0eacaa3cda53-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:03.927714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:03.927510 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afddc30a-a614-4eec-b404-0eacaa3cda53-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:23:04.185770 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.185737 2585 generic.go:356] "Generic (PLEG): container finished" podID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerID="b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501" exitCode=0 Jul 20 16:23:04.186018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.185786 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" Jul 20 16:23:04.186018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.185825 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerDied","Data":"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501"} Jul 20 16:23:04.186018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.185895 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn" event={"ID":"afddc30a-a614-4eec-b404-0eacaa3cda53","Type":"ContainerDied","Data":"506661ba3b766377bdb8d6c2e017d0ee0546e6334e31b1701714f5350c60326f"} Jul 20 16:23:04.186018 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.185927 2585 scope.go:117] "RemoveContainer" containerID="b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501" Jul 20 16:23:04.197892 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.197875 2585 scope.go:117] "RemoveContainer" containerID="9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59" Jul 20 16:23:04.206662 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.206644 2585 scope.go:117] "RemoveContainer" containerID="b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501" Jul 20 16:23:04.206908 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:23:04.206888 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501\": container with ID starting with b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501 not found: ID does not exist" containerID="b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501" Jul 20 16:23:04.206977 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.206916 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501"} err="failed to get container status \"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501\": rpc error: code = NotFound desc = could not find container \"b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501\": container with ID starting with b22bddf7a7fec59a0e8fc66d18b558b441f60bfb0b9af15a35310b0f1025b501 not found: ID does not exist" Jul 20 16:23:04.206977 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.206933 2585 scope.go:117] "RemoveContainer" containerID="9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59" Jul 20 16:23:04.207192 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:23:04.207148 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59\": container with ID starting with 9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59 not found: ID does not exist" containerID="9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59" Jul 20 16:23:04.207238 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.207198 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59"} err="failed to get container status \"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59\": rpc error: code = NotFound desc = could not find container \"9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59\": container with ID starting with 9b5f0bbd4cf821066189ea44354780afcaa7b3193e7727c9fdb85db31efaad59 not found: ID does not exist" Jul 20 16:23:04.213423 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.213401 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:23:04.215635 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:04.215617 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0df208ce-openshift-default-68c695d459-wjtbn"] Jul 20 16:23:05.540860 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:05.540818 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" path="/var/lib/kubelet/pods/afddc30a-a614-4eec-b404-0eacaa3cda53/volumes" Jul 20 16:23:18.295115 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295024 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295471 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295491 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295520 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295530 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295556 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295566 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c1ad79-f18f-4d5b-8e5c-23850302bf4b" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295651 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7072519b-7023-4f60-9abc-9424bc0cfe4a" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295660 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.295736 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.295667 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="afddc30a-a614-4eec-b404-0eacaa3cda53" containerName="istio-proxy" Jul 20 16:23:18.300372 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.300351 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.303109 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.303089 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aef3b1b4-openshift-default-dockercfg-j2mgx\"" Jul 20 16:23:18.312006 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.311980 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:23:18.365838 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.365806 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366000 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.365847 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366000 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.365930 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366000 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.365950 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfh99\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366113 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.366005 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366113 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.366050 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366113 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.366079 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366237 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.366132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.366237 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.366150 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467107 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467061 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467118 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467145 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467195 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467225 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467627 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467323 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfh99\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467627 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467734 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467563 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467766 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467628 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.467811 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467592 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.468023 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.467992 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.469697 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.469670 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.469802 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.469749 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.475479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.475455 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.475608 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.475590 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfh99\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99\") pod \"e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.611986 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.611886 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:18.752226 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.752200 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:23:18.754088 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:23:18.754050 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933e9b43_907e_401c_b11f_e35f58f012a4.slice/crio-26b221bf85ef1b151f2ae972818a83e85cd1d38217beb7d308f0743ec5d4c541 WatchSource:0}: Error finding container 26b221bf85ef1b151f2ae972818a83e85cd1d38217beb7d308f0743ec5d4c541: Status 404 returned error can't find the container with id 26b221bf85ef1b151f2ae972818a83e85cd1d38217beb7d308f0743ec5d4c541 Jul 20 16:23:18.756335 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.756302 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:18.756433 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.756367 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:18.756433 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:18.756396 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:19.268345 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:19.268307 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerStarted","Data":"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a"} Jul 20 16:23:19.268546 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:19.268364 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerStarted","Data":"26b221bf85ef1b151f2ae972818a83e85cd1d38217beb7d308f0743ec5d4c541"} Jul 20 16:23:19.291056 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:19.291007 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podStartSLOduration=1.290991164 podStartE2EDuration="1.290991164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:23:19.289600639 +0000 UTC m=+1976.236056293" watchObservedRunningTime="2026-07-20 16:23:19.290991164 +0000 UTC m=+1976.237446819" Jul 20 16:23:19.612866 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:19.612781 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:19.617836 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:19.617811 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:20.274019 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:20.273990 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:20.274972 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:20.274950 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:26.001482 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:26.001439 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:23:34.355405 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.355370 2585 generic.go:356] "Generic (PLEG): container finished" podID="933e9b43-907e-401c-b11f-e35f58f012a4" containerID="e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a" exitCode=0 Jul 20 16:23:34.355825 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.355445 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerDied","Data":"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a"} Jul 20 16:23:34.355867 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.355830 2585 scope.go:117] "RemoveContainer" containerID="e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a" Jul 20 16:23:34.356807 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.356783 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:34.356860 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.356846 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:34.356895 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:34.356876 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:23:35.274429 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:35.274392 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:35.367510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:35.367470 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerStarted","Data":"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64"} Jul 20 16:23:35.613030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:35.612928 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:35.614227 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:35.614204 2585 patch_prober.go:28] interesting pod/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:23:35.614340 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:35.614251 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:23:36.216618 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:36.216577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:23:36.613146 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:36.613056 2585 patch_prober.go:28] interesting pod/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:23:36.613146 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:36.613108 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:23:37.613020 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:37.612986 2585 patch_prober.go:28] interesting pod/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:23:37.613197 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:37.613039 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:23:38.612830 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:38.612792 2585 patch_prober.go:28] interesting pod/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 20 16:23:38.613014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:38.612852 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 20 16:23:39.616172 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:39.616117 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:39.616539 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:39.616398 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:39.617097 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:39.617077 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:23:58.110651 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:23:58.110617 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:24:18.612888 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:24:18.612853 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:24:29.004523 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:24:29.004486 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:25:15.166283 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:15.166190 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:25:15.166864 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:15.166508 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" containerID="cri-o://d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64" gracePeriod=30 Jul 20 16:25:20.431943 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.431918 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:25:20.485262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485234 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485274 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485292 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485336 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485362 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485387 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485550 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485644 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfh99\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485648 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:25:20.485731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485681 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert\") pod \"933e9b43-907e-401c-b11f-e35f58f012a4\" (UID: \"933e9b43-907e-401c-b11f-e35f58f012a4\") " Jul 20 16:25:20.485731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485694 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:25:20.486006 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485953 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.486006 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.485972 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.486207 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.486177 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:25:20.486301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.486233 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:25:20.486757 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.486730 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:25:20.488026 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.487993 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:25:20.488320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.488136 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:25:20.488320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.488198 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99" (OuterVolumeSpecName: "kube-api-access-cfh99") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "kube-api-access-cfh99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:25:20.488320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.488226 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "933e9b43-907e-401c-b11f-e35f58f012a4" (UID: "933e9b43-907e-401c-b11f-e35f58f012a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:25:20.586849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586815 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfh99\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-kube-api-access-cfh99\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.586849 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586847 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933e9b43-907e-401c-b11f-e35f58f012a4-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.587062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586872 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933e9b43-907e-401c-b11f-e35f58f012a4-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.587062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586896 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.587062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586912 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.587062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586925 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933e9b43-907e-401c-b11f-e35f58f012a4-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.587062 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.586940 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933e9b43-907e-401c-b11f-e35f58f012a4-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:25:20.939693 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.939664 2585 generic.go:356] "Generic (PLEG): container finished" podID="933e9b43-907e-401c-b11f-e35f58f012a4" containerID="d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64" exitCode=0 Jul 20 16:25:20.939874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.939718 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" Jul 20 16:25:20.939874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.939753 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerDied","Data":"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64"} Jul 20 16:25:20.939874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.939815 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k" event={"ID":"933e9b43-907e-401c-b11f-e35f58f012a4","Type":"ContainerDied","Data":"26b221bf85ef1b151f2ae972818a83e85cd1d38217beb7d308f0743ec5d4c541"} Jul 20 16:25:20.939874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.939846 2585 scope.go:117] "RemoveContainer" containerID="d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64" Jul 20 16:25:20.953951 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.953784 2585 scope.go:117] "RemoveContainer" containerID="e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a" Jul 20 16:25:20.965477 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.965451 2585 scope.go:117] "RemoveContainer" containerID="d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64" Jul 20 16:25:20.965841 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:25:20.965821 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64\": container with ID starting with d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64 not found: ID does not exist" containerID="d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64" Jul 20 16:25:20.965917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.965849 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64"} err="failed to get container status \"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64\": rpc error: code = NotFound desc = could not find container \"d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64\": container with ID starting with d68bd4afecb9f133bf53dffabc70bbb3398a6e66a4cd0d76241f677793893f64 not found: ID does not exist" Jul 20 16:25:20.965917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.965868 2585 scope.go:117] "RemoveContainer" containerID="e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a" Jul 20 16:25:20.966146 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:25:20.966112 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a\": container with ID starting with e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a not found: ID does not exist" containerID="e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a" Jul 20 16:25:20.966230 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.966140 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a"} err="failed to get container status \"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a\": rpc error: code = NotFound desc = could not find container \"e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a\": container with ID starting with e98a5fee447c50e229121610e1eeb31f00a49a600572d0c899d01a552b3e861a not found: ID does not exist" Jul 20 16:25:20.967024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.967003 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:25:20.969859 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:20.969839 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aef3b1b4-openshift-default-bc69b98cf-fm72k"] Jul 20 16:25:21.541109 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:21.541076 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" path="/var/lib/kubelet/pods/933e9b43-907e-401c-b11f-e35f58f012a4/volumes" Jul 20 16:25:23.664078 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:23.664053 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:25:23.669361 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:23.669334 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:25:23.708446 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:23.708420 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:25:23.715287 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:23.715263 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:25:26.216279 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:26.216241 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:25:34.316133 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:25:34.316090 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:26:12.664873 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.664834 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:26:12.665396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.665218 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:12.665396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.665229 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:12.665396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.665237 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:12.665396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.665243 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:12.665396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.665323 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:12.668336 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.668319 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.671123 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.671098 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f3d110-openshift-default-dockercfg-2jgwd\"" Jul 20 16:26:12.684610 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.684577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:26:12.752003 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.751963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752029 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752056 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752081 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752197 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v6v8\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752422 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752422 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752269 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.752422 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.752298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853396 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853480 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853513 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v6v8\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853673 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853707 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853882 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.853917 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853901 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.854110 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.853953 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.854110 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.854026 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.854460 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.854443 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.855872 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.855844 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.856070 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.856050 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.863266 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.863241 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.864546 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.864529 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v6v8\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8\") pod \"e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:12.978439 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:12.978403 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:13.129347 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.129314 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:26:13.130775 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:26:13.130740 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bffd4c4_bc1b_4565_ad89_22243b31b5d3.slice/crio-b89ce52eaa452aa7bab788e91ba3170b621807e891ea6a723435037d26ac19fb WatchSource:0}: Error finding container b89ce52eaa452aa7bab788e91ba3170b621807e891ea6a723435037d26ac19fb: Status 404 returned error can't find the container with id b89ce52eaa452aa7bab788e91ba3170b621807e891ea6a723435037d26ac19fb Jul 20 16:26:13.133137 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.133105 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:13.133239 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.133195 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:13.133239 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.133228 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:13.237465 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.237373 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerStarted","Data":"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6"} Jul 20 16:26:13.237465 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.237425 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerStarted","Data":"b89ce52eaa452aa7bab788e91ba3170b621807e891ea6a723435037d26ac19fb"} Jul 20 16:26:13.261205 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.261133 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podStartSLOduration=1.261112459 podStartE2EDuration="1.261112459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:26:13.258255232 +0000 UTC m=+2150.204710888" watchObservedRunningTime="2026-07-20 16:26:13.261112459 +0000 UTC m=+2150.207568117" Jul 20 16:26:13.979493 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:13.979450 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:14.983873 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:14.983841 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:15.249510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:15.249429 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:15.250556 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:15.250533 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:20.316875 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.316790 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:26:20.317512 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.317490 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="933e9b43-907e-401c-b11f-e35f58f012a4" containerName="istio-proxy" Jul 20 16:26:20.321304 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.321281 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.324042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.324014 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-18d8b0-openshift-default-dockercfg-rc2jg\"" Jul 20 16:26:20.333573 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.333549 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:26:20.423946 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.423905 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.423957 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w2n\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424051 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424078 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424113 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424350 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.424436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.424377 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525274 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525232 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525274 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525275 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525297 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525369 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525392 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525420 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525555 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525859 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w2n\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525859 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525713 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.525859 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.525727 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.526067 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.526042 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.526133 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.526072 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.526133 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.526110 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.528280 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.528254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.528493 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.528477 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.534311 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.534285 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.534713 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.534690 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w2n\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n\") pod \"e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.634883 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.634791 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:20.778647 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:26:20.778613 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfd5023_1a58_4c87_9082_8c98f99b39d5.slice/crio-80d2ad399f8858cd3b60ef6647803a6ffbc9c5f05a492965eec6865ae4ece8f6 WatchSource:0}: Error finding container 80d2ad399f8858cd3b60ef6647803a6ffbc9c5f05a492965eec6865ae4ece8f6: Status 404 returned error can't find the container with id 80d2ad399f8858cd3b60ef6647803a6ffbc9c5f05a492965eec6865ae4ece8f6 Jul 20 16:26:20.780874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.780830 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:20.780971 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.780931 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:20.781015 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.780980 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:20.781086 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:20.781064 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:26:21.283081 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:21.283044 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerStarted","Data":"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8"} Jul 20 16:26:21.283286 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:21.283094 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerStarted","Data":"80d2ad399f8858cd3b60ef6647803a6ffbc9c5f05a492965eec6865ae4ece8f6"} Jul 20 16:26:21.307487 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:21.307436 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podStartSLOduration=1.307419933 podStartE2EDuration="1.307419933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:26:21.304819598 +0000 UTC m=+2158.251275264" watchObservedRunningTime="2026-07-20 16:26:21.307419933 +0000 UTC m=+2158.253875587" Jul 20 16:26:21.635502 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:21.635407 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:21.640737 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:21.640711 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:22.290055 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:22.290024 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:22.291181 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:22.291136 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:22.918990 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:22.918954 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:26:30.978116 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:30.976474 2585 patch_prober.go:28] interesting pod/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:34250->10.132.0.58:15021: read: connection reset by peer" start-of-body= Jul 20 16:26:30.978116 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:30.976550 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:34250->10.132.0.58:15021: read: connection reset by peer" Jul 20 16:26:31.339871 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.339781 2585 generic.go:356] "Generic (PLEG): container finished" podID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerID="90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6" exitCode=0 Jul 20 16:26:31.339871 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.339859 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerDied","Data":"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6"} Jul 20 16:26:31.340276 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.340262 2585 scope.go:117] "RemoveContainer" containerID="90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6" Jul 20 16:26:31.341271 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.341245 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:31.341361 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.341311 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:31.341361 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:31.341342 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:32.353237 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:32.352036 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerStarted","Data":"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875"} Jul 20 16:26:32.979801 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:32.979763 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:32.980193 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:32.980087 2585 patch_prober.go:28] interesting pod/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 16:26:32.980387 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:32.980362 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 16:26:33.979764 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:33.979322 2585 patch_prober.go:28] interesting pod/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 16:26:33.979764 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:33.979384 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 16:26:34.979613 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:34.979575 2585 patch_prober.go:28] interesting pod/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 16:26:34.980322 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:34.979897 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 16:26:35.979247 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:35.979202 2585 patch_prober.go:28] interesting pod/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 20 16:26:35.979462 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:35.979272 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 20 16:26:36.983190 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:36.983136 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:36.983684 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:36.983538 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:36.984427 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:36.984406 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:26:37.230030 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:37.229999 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:26:38.332343 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:38.332300 2585 patch_prober.go:28] interesting pod/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:26:38.332733 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:38.332357 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:26:39.413097 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.413008 2585 generic.go:356] "Generic (PLEG): container finished" podID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerID="aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8" exitCode=0 Jul 20 16:26:39.413097 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.413057 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerDied","Data":"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8"} Jul 20 16:26:39.413565 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.413431 2585 scope.go:117] "RemoveContainer" containerID="aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8" Jul 20 16:26:39.414795 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.414688 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:39.414910 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.414888 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:39.414985 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:39.414965 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:26:40.420618 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:40.420586 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerStarted","Data":"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888"} Jul 20 16:26:40.635754 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:40.635719 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:40.636031 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:40.636008 2585 patch_prober.go:28] interesting pod/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 16:26:40.636124 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:40.636060 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 16:26:41.636107 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:41.636068 2585 patch_prober.go:28] interesting pod/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 16:26:41.636518 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:41.636121 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 16:26:42.635966 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:42.635924 2585 patch_prober.go:28] interesting pod/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 16:26:42.636226 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:42.635991 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 16:26:43.635495 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:43.635460 2585 patch_prober.go:28] interesting pod/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 20 16:26:43.635707 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:43.635518 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 20 16:26:44.639489 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:44.639455 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:44.639954 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:44.639885 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:44.640618 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:44.640593 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:26:52.223429 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:26:52.223383 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:27:36.719951 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:27:36.719911 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:27:50.305250 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:27:50.305147 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:28:22.817788 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:22.817749 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:28:39.012568 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:39.012530 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:28:41.162331 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:41.162300 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:28:41.162793 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:41.162551 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" containerID="cri-o://c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875" gracePeriod=30 Jul 20 16:28:46.427926 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.427854 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:28:46.496732 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496690 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v6v8\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496732 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496734 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496806 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496831 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496865 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496887 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496922 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.496997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.496989 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.497354 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497012 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert\") pod \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\" (UID: \"5bffd4c4-bc1b-4565-ad89-22243b31b5d3\") " Jul 20 16:28:46.497354 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497146 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:28:46.497470 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497385 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.497470 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497398 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:28:46.497582 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497483 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:28:46.497582 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497555 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:28:46.497797 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.497769 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:28:46.499202 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.499166 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:28:46.499339 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.499321 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:28:46.499471 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.499451 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:28:46.499515 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.499468 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8" (OuterVolumeSpecName: "kube-api-access-9v6v8") pod "5bffd4c4-bc1b-4565-ad89-22243b31b5d3" (UID: "5bffd4c4-bc1b-4565-ad89-22243b31b5d3"). InnerVolumeSpecName "kube-api-access-9v6v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:28:46.598746 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598708 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598746 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598745 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598759 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598772 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598786 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598800 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v6v8\" (UniqueName: \"kubernetes.io/projected/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-kube-api-access-9v6v8\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598827 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:46.598994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:46.598839 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffd4c4-bc1b-4565-ad89-22243b31b5d3-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:28:47.124649 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.124614 2585 generic.go:356] "Generic (PLEG): container finished" podID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerID="c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875" exitCode=0 Jul 20 16:28:47.124853 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.124668 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" Jul 20 16:28:47.124853 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.124703 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerDied","Data":"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875"} Jul 20 16:28:47.124853 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.124771 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99" event={"ID":"5bffd4c4-bc1b-4565-ad89-22243b31b5d3","Type":"ContainerDied","Data":"b89ce52eaa452aa7bab788e91ba3170b621807e891ea6a723435037d26ac19fb"} Jul 20 16:28:47.124853 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.124802 2585 scope.go:117] "RemoveContainer" containerID="c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875" Jul 20 16:28:47.134712 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.134692 2585 scope.go:117] "RemoveContainer" containerID="90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6" Jul 20 16:28:47.143863 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.143842 2585 scope.go:117] "RemoveContainer" containerID="c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875" Jul 20 16:28:47.144178 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:28:47.144144 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875\": container with ID starting with c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875 not found: ID does not exist" containerID="c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875" Jul 20 16:28:47.144248 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.144189 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875"} err="failed to get container status \"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875\": rpc error: code = NotFound desc = could not find container \"c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875\": container with ID starting with c4b0fad2a1111006cd520d293b1d02ac152c210d9e3f9c906f0b663292a1f875 not found: ID does not exist" Jul 20 16:28:47.144248 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.144209 2585 scope.go:117] "RemoveContainer" containerID="90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6" Jul 20 16:28:47.144441 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:28:47.144424 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6\": container with ID starting with 90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6 not found: ID does not exist" containerID="90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6" Jul 20 16:28:47.144491 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.144446 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6"} err="failed to get container status \"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6\": rpc error: code = NotFound desc = could not find container \"90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6\": container with ID starting with 90b132e9429184e2bd081d6d7d68707482107ee7f41b7c96f4b57f6096da3cd6 not found: ID does not exist" Jul 20 16:28:47.155591 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.155563 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:28:47.157881 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.157857 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f3d110-openshift-default-7b66dd7d47-pgc99"] Jul 20 16:28:47.542120 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:47.542079 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" path="/var/lib/kubelet/pods/5bffd4c4-bc1b-4565-ad89-22243b31b5d3/volumes" Jul 20 16:28:55.220433 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:28:55.220386 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:29:03.317922 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:03.317885 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:29:03.318437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:03.318184 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" containerID="cri-o://262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888" gracePeriod=30 Jul 20 16:29:04.233646 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.233617 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:29:04.233986 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.233974 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:04.234037 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.233987 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:04.234037 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.234013 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:04.234037 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.234019 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:04.234144 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.234071 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:04.237082 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.237066 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.239791 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.239775 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c4f6bb-openshift-default-dockercfg-p5z5r\"" Jul 20 16:29:04.250764 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.250735 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:29:04.358419 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358428 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358454 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358517 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358546 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358607 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358656 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz66g\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.358819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.358703 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459609 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459569 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459623 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459685 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459734 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz66g\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459773 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.459809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460094 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.459952 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460094 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460002 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460094 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460179 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460273 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460423 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460408 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460541 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460515 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.460731 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.460708 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.462794 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.462762 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.462907 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.462893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.488007 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.487944 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz66g\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.489295 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.489272 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token\") pod \"e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.548919 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.548875 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:04.694458 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.694425 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:29:04.695316 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:29:04.695289 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62e49a7_18d1_4442_a671_c0f03e31ac58.slice/crio-fdc973ae601efca6ee93d3d0b2fb28214cb22eeb6cfae79144fe85a4074e84e8 WatchSource:0}: Error finding container fdc973ae601efca6ee93d3d0b2fb28214cb22eeb6cfae79144fe85a4074e84e8: Status 404 returned error can't find the container with id fdc973ae601efca6ee93d3d0b2fb28214cb22eeb6cfae79144fe85a4074e84e8 Jul 20 16:29:04.697412 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.697382 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:04.697486 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.697444 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:04.697486 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:04.697471 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:05.230066 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:05.230029 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerStarted","Data":"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81"} Jul 20 16:29:05.230283 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:05.230085 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerStarted","Data":"fdc973ae601efca6ee93d3d0b2fb28214cb22eeb6cfae79144fe85a4074e84e8"} Jul 20 16:29:05.254335 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:05.254288 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podStartSLOduration=1.254272365 podStartE2EDuration="1.254272365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:05.253148208 +0000 UTC m=+2322.199603862" watchObservedRunningTime="2026-07-20 16:29:05.254272365 +0000 UTC m=+2322.200728019" Jul 20 16:29:05.549362 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:05.549275 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:05.553992 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:05.553965 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:06.236494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:06.236461 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:06.237658 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:06.237635 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:08.587374 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.587312 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:29:08.608013 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.607986 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28w2n\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608037 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608077 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608184 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608211 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608207 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608438 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608239 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608438 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608264 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608438 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608325 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608438 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608349 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy\") pod \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\" (UID: \"5bfd5023-1a58-4c87-9082-8c98f99b39d5\") " Jul 20 16:29:08.608438 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608373 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:29:08.608679 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608461 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:29:08.608738 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608672 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:29:08.608819 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608791 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:29:08.608997 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.608975 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.609085 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.609005 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.609205 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.609176 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:29:08.610452 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.610424 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:29:08.610452 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.610441 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n" (OuterVolumeSpecName: "kube-api-access-28w2n") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "kube-api-access-28w2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:29:08.610617 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.610600 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:29:08.610664 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.610639 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5bfd5023-1a58-4c87-9082-8c98f99b39d5" (UID: "5bfd5023-1a58-4c87-9082-8c98f99b39d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:29:08.710236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710194 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710227 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710236 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710244 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710252 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28w2n\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-kube-api-access-28w2n\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710263 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:08.710510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:08.710271 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bfd5023-1a58-4c87-9082-8c98f99b39d5-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:29:09.254342 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.254310 2585 generic.go:356] "Generic (PLEG): container finished" podID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerID="262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888" exitCode=0 Jul 20 16:29:09.254549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.254362 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" Jul 20 16:29:09.254549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.254395 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerDied","Data":"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888"} Jul 20 16:29:09.254549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.254453 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz" event={"ID":"5bfd5023-1a58-4c87-9082-8c98f99b39d5","Type":"ContainerDied","Data":"80d2ad399f8858cd3b60ef6647803a6ffbc9c5f05a492965eec6865ae4ece8f6"} Jul 20 16:29:09.254549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.254476 2585 scope.go:117] "RemoveContainer" containerID="262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888" Jul 20 16:29:09.264349 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.264328 2585 scope.go:117] "RemoveContainer" containerID="aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8" Jul 20 16:29:09.273089 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.273067 2585 scope.go:117] "RemoveContainer" containerID="262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888" Jul 20 16:29:09.273403 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:29:09.273379 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888\": container with ID starting with 262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888 not found: ID does not exist" containerID="262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888" Jul 20 16:29:09.273504 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.273410 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888"} err="failed to get container status \"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888\": rpc error: code = NotFound desc = could not find container \"262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888\": container with ID starting with 262ad5857ffbb90052aed08e05759201d1100247e7d42b61551e08380ed4a888 not found: ID does not exist" Jul 20 16:29:09.273504 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.273428 2585 scope.go:117] "RemoveContainer" containerID="aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8" Jul 20 16:29:09.273658 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:29:09.273639 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8\": container with ID starting with aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8 not found: ID does not exist" containerID="aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8" Jul 20 16:29:09.273697 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.273665 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8"} err="failed to get container status \"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8\": rpc error: code = NotFound desc = could not find container \"aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8\": container with ID starting with aa9a0f6217de2785f4c261af5b4c7827317c02d08b3601638df60fc630d761e8 not found: ID does not exist" Jul 20 16:29:09.277443 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.277420 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:29:09.282716 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.282693 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-18d8b0-openshift-default-6cc5d5ddd9-g27jz"] Jul 20 16:29:09.542800 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:09.542722 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" path="/var/lib/kubelet/pods/5bfd5023-1a58-4c87-9082-8c98f99b39d5/volumes" Jul 20 16:29:12.499554 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499521 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:29:12.499921 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499871 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.499921 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499882 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.499921 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499893 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.499921 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499899 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.500053 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499970 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.500053 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499979 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bffd4c4-bc1b-4565-ad89-22243b31b5d3" containerName="istio-proxy" Jul 20 16:29:12.500053 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.499987 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bfd5023-1a58-4c87-9082-8c98f99b39d5" containerName="istio-proxy" Jul 20 16:29:12.504393 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.504370 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.507629 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.507610 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-af2b09-openshift-default-dockercfg-xg88x\"" Jul 20 16:29:12.519512 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.519486 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:29:12.544954 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.544916 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.544954 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.544956 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.544982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545094 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545195 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrsr\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545245 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545234 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545461 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545260 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.545461 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.545306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.646609 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.646609 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646610 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.646879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646635 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.646879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646768 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.646879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrsr\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646935 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.646962 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647032 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647337 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647337 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647177 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647347 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.647770 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.647750 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.649228 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.649207 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.649368 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.649349 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.657027 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.657003 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.657126 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.657063 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrsr\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr\") pod \"e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.815071 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.814976 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:12.961585 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.961556 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:29:12.963134 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:29:12.963109 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2a71bd_5032_4084_909f_0fce411405d1.slice/crio-81e3c500f12c6c98f5cf8b9f38d95b1ca32e574dd491800f2fd1aa16d541caa8 WatchSource:0}: Error finding container 81e3c500f12c6c98f5cf8b9f38d95b1ca32e574dd491800f2fd1aa16d541caa8: Status 404 returned error can't find the container with id 81e3c500f12c6c98f5cf8b9f38d95b1ca32e574dd491800f2fd1aa16d541caa8 Jul 20 16:29:12.965391 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.965355 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:12.965457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.965441 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:12.965506 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:12.965489 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:13.280418 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:13.280375 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerStarted","Data":"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17"} Jul 20 16:29:13.280596 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:13.280433 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerStarted","Data":"81e3c500f12c6c98f5cf8b9f38d95b1ca32e574dd491800f2fd1aa16d541caa8"} Jul 20 16:29:13.303637 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:13.303585 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podStartSLOduration=1.30356852 podStartE2EDuration="1.30356852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:29:13.301480261 +0000 UTC m=+2330.247935921" watchObservedRunningTime="2026-07-20 16:29:13.30356852 +0000 UTC m=+2330.250024174" Jul 20 16:29:13.815107 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:13.815070 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:14.716007 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:14.715967 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:29:14.820585 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:14.820556 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:15.291123 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:15.291088 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:15.292182 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:15.292141 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:22.278317 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:22.278276 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:29:22.278719 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:22.278360 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:29:23.341953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.341860 2585 generic.go:356] "Generic (PLEG): container finished" podID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerID="6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81" exitCode=0 Jul 20 16:29:23.341953 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.341937 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerDied","Data":"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81"} Jul 20 16:29:23.342540 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.342360 2585 scope.go:117] "RemoveContainer" containerID="6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81" Jul 20 16:29:23.343396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.343370 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:23.343470 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.343432 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:23.343470 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:23.343464 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:24.354290 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:24.354132 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerStarted","Data":"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496"} Jul 20 16:29:24.549476 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:24.549439 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:24.549686 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:24.549496 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 16:29:24.549686 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:24.549564 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 16:29:25.549812 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:25.549771 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 16:29:25.550365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:25.549861 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 16:29:26.549853 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:26.549805 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 16:29:26.550490 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:26.549877 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 16:29:27.549478 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:27.549431 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 20 16:29:27.549693 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:27.549501 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 20 16:29:28.555789 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:28.555741 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:28.556888 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:28.556853 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:28.558167 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:28.558123 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:29:31.333354 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:31.333309 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 20 16:29:31.333810 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:31.333377 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 20 16:29:31.505829 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:31.505793 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:29:33.419888 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.419858 2585 generic.go:356] "Generic (PLEG): container finished" podID="9a2a71bd-5032-4084-909f-0fce411405d1" containerID="21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17" exitCode=0 Jul 20 16:29:33.420327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.419930 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerDied","Data":"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17"} Jul 20 16:29:33.420375 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.420340 2585 scope.go:117] "RemoveContainer" containerID="21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17" Jul 20 16:29:33.421319 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.421290 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:33.421394 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.421377 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:33.421443 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:33.421429 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:29:34.426991 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:34.426956 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerStarted","Data":"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f"} Jul 20 16:29:34.815713 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:34.815671 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:34.815942 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:34.815914 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 16:29:34.815990 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:34.815972 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 16:29:35.815593 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:35.815539 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 16:29:35.816078 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:35.815611 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 16:29:36.815976 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:36.815937 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 16:29:36.816429 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:36.815990 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 16:29:37.815465 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:37.815425 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 20 16:29:37.815648 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:37.815485 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 20 16:29:38.818738 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:38.818707 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:38.819207 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:38.818987 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:38.819647 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:38.819632 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:29:47.704025 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:47.703984 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:29:55.077066 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:55.077029 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:29:55.077469 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:55.077273 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" containerID="cri-o://97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496" gracePeriod=30 Jul 20 16:29:58.558971 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:58.558933 2585 patch_prober.go:28] interesting pod/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:29:58.559479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:29:58.558990 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:30:00.343550 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.343486 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:30:00.392905 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.392871 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.392905 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.392907 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.392939 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.392982 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393033 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393064 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393097 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393123 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz66g\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393298 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:00.393479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393360 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs\") pod \"c62e49a7-18d1-4442-a671-c0f03e31ac58\" (UID: \"c62e49a7-18d1-4442-a671-c0f03e31ac58\") " Jul 20 16:30:00.393639 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393612 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:30:00.393892 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393869 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c62e49a7-18d1-4442-a671-c0f03e31ac58-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.394015 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.393897 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.394086 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.394043 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data" (OuterVolumeSpecName: "istio-data") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:00.394143 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.394077 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:00.394143 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.394108 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:00.395369 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.395340 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token" (OuterVolumeSpecName: "istio-token") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:30:00.395462 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.395409 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g" (OuterVolumeSpecName: "kube-api-access-pz66g") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "kube-api-access-pz66g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:30:00.395832 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.395807 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:00.395934 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.395856 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c62e49a7-18d1-4442-a671-c0f03e31ac58" (UID: "c62e49a7-18d1-4442-a671-c0f03e31ac58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:30:00.494702 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494664 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.494702 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494696 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.494702 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494706 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.494702 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494714 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz66g\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-kube-api-access-pz66g\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.495075 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494724 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.495075 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494732 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.495075 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.494739 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c62e49a7-18d1-4442-a671-c0f03e31ac58-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:00.577320 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.577284 2585 generic.go:356] "Generic (PLEG): container finished" podID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerID="97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496" exitCode=0 Jul 20 16:30:00.577484 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.577337 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" Jul 20 16:30:00.577484 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.577364 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerDied","Data":"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496"} Jul 20 16:30:00.577484 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.577415 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh" event={"ID":"c62e49a7-18d1-4442-a671-c0f03e31ac58","Type":"ContainerDied","Data":"fdc973ae601efca6ee93d3d0b2fb28214cb22eeb6cfae79144fe85a4074e84e8"} Jul 20 16:30:00.577484 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.577437 2585 scope.go:117] "RemoveContainer" containerID="97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496" Jul 20 16:30:00.586777 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.586760 2585 scope.go:117] "RemoveContainer" containerID="6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81" Jul 20 16:30:00.595101 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.595078 2585 scope.go:117] "RemoveContainer" containerID="97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496" Jul 20 16:30:00.595404 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:30:00.595380 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496\": container with ID starting with 97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496 not found: ID does not exist" containerID="97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496" Jul 20 16:30:00.595545 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.595411 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496"} err="failed to get container status \"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496\": rpc error: code = NotFound desc = could not find container \"97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496\": container with ID starting with 97f499d6bc81666f39f89db0d9be0ebc3297d8cd9325c344bc032e4584bb1496 not found: ID does not exist" Jul 20 16:30:00.595545 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.595436 2585 scope.go:117] "RemoveContainer" containerID="6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81" Jul 20 16:30:00.595752 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:30:00.595724 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81\": container with ID starting with 6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81 not found: ID does not exist" containerID="6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81" Jul 20 16:30:00.595790 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.595763 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81"} err="failed to get container status \"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81\": rpc error: code = NotFound desc = could not find container \"6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81\": container with ID starting with 6f7223e79711ade662cdeaa95cdd52b5214ec1ae3bd7aa25e9937bbe02e29f81 not found: ID does not exist" Jul 20 16:30:00.619908 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.619876 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:30:00.632895 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:00.632867 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c4f6bb-openshift-default-6575799765-8b6gh"] Jul 20 16:30:01.547456 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:01.547423 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" path="/var/lib/kubelet/pods/c62e49a7-18d1-4442-a671-c0f03e31ac58/volumes" Jul 20 16:30:15.903140 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:15.903094 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:30:22.158048 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:22.158013 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:30:22.158581 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:22.158252 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" containerID="cri-o://6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f" gracePeriod=30 Jul 20 16:30:23.061131 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.061099 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:30:23.061531 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.061516 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:23.061590 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.061533 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:23.061640 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.061611 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:23.061640 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.061623 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:23.066241 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.066223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.068961 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.068941 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-329d3d-openshift-default-dockercfg-rjq6h\"" Jul 20 16:30:23.077433 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.077407 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:30:23.204238 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204238 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5597\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204325 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204361 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204393 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204413 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204490 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.204689 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.204532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.305976 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.305923 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306331 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5597\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306415 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306530 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306565 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306630 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307277 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.306696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307856 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.307403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.307856 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.307676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.308792 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.308557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.313260 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.310401 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.313524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.313504 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.314066 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.314044 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.316024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.315998 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5597\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.316488 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.316465 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token\") pod \"e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.377797 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.377759 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:23.542386 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:30:23.542349 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827c4387_9d59_4c16_89c3_284bc638e947.slice/crio-21da0e18e203aaaebfe64a15d651e971b9de0feb415a10e453762c1d5c06e0c1 WatchSource:0}: Error finding container 21da0e18e203aaaebfe64a15d651e971b9de0feb415a10e453762c1d5c06e0c1: Status 404 returned error can't find the container with id 21da0e18e203aaaebfe64a15d651e971b9de0feb415a10e453762c1d5c06e0c1 Jul 20 16:30:23.543925 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.543906 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:30:23.544718 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.544683 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:23.544799 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.544762 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:23.544848 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.544809 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:23.705121 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.705093 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:30:23.706781 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.706745 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerStarted","Data":"adbd2831c9c4a201f1fc8d9a73c8457273be2aa671c622fff7b585f4e55a6219"} Jul 20 16:30:23.706929 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.706807 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerStarted","Data":"21da0e18e203aaaebfe64a15d651e971b9de0feb415a10e453762c1d5c06e0c1"} Jul 20 16:30:23.714653 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.714628 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:30:23.728874 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.728818 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podStartSLOduration=0.728798748 podStartE2EDuration="728.798748ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:23.725998695 +0000 UTC m=+2400.672454351" watchObservedRunningTime="2026-07-20 16:30:23.728798748 +0000 UTC m=+2400.675254404" Jul 20 16:30:23.751923 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.751895 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:30:23.758574 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.758549 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:30:23.821835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.821753 2585 patch_prober.go:28] interesting pod/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 20 16:30:23.821835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:23.821817 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 20 16:30:24.378494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:24.378454 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:24.383743 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:24.383718 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:24.711930 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:24.711901 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:24.712986 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:24.712962 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:27.417831 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.417770 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:30:27.548051 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548021 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548051 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548056 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548076 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548142 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548188 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548210 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548244 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxrsr\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548266 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548562 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548287 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert\") pod \"9a2a71bd-5032-4084-909f-0fce411405d1\" (UID: \"9a2a71bd-5032-4084-909f-0fce411405d1\") " Jul 20 16:30:27.548562 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548344 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:27.548562 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548411 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:27.548717 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548627 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.548717 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548630 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:27.548717 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548646 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.548879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548735 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:30:27.548960 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.548933 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:27.550501 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.550477 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr" (OuterVolumeSpecName: "kube-api-access-vxrsr") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "kube-api-access-vxrsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:30:27.550639 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.550616 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:30:27.550848 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.550825 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:30:27.550891 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.550863 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a2a71bd-5032-4084-909f-0fce411405d1" (UID: "9a2a71bd-5032-4084-909f-0fce411405d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:30:27.649932 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649892 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.649932 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649929 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.649932 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649943 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.650204 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649955 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a2a71bd-5032-4084-909f-0fce411405d1-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.650204 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649964 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrsr\" (UniqueName: \"kubernetes.io/projected/9a2a71bd-5032-4084-909f-0fce411405d1-kube-api-access-vxrsr\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.650204 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649973 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a2a71bd-5032-4084-909f-0fce411405d1-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.650204 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.649981 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a2a71bd-5032-4084-909f-0fce411405d1-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:30:27.732093 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.732063 2585 generic.go:356] "Generic (PLEG): container finished" podID="9a2a71bd-5032-4084-909f-0fce411405d1" containerID="6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f" exitCode=0 Jul 20 16:30:27.732301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.732143 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" Jul 20 16:30:27.732301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.732148 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerDied","Data":"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f"} Jul 20 16:30:27.732301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.732220 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7" event={"ID":"9a2a71bd-5032-4084-909f-0fce411405d1","Type":"ContainerDied","Data":"81e3c500f12c6c98f5cf8b9f38d95b1ca32e574dd491800f2fd1aa16d541caa8"} Jul 20 16:30:27.732301 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.732243 2585 scope.go:117] "RemoveContainer" containerID="6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f" Jul 20 16:30:27.742340 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.742321 2585 scope.go:117] "RemoveContainer" containerID="21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17" Jul 20 16:30:27.751809 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.751790 2585 scope.go:117] "RemoveContainer" containerID="6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f" Jul 20 16:30:27.752088 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:30:27.752070 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f\": container with ID starting with 6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f not found: ID does not exist" containerID="6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f" Jul 20 16:30:27.752136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.752096 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f"} err="failed to get container status \"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f\": rpc error: code = NotFound desc = could not find container \"6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f\": container with ID starting with 6a167c859ea9ef7a25ee498b6d48405edb66ec8c289e61dc65c67bb0958ba55f not found: ID does not exist" Jul 20 16:30:27.752136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.752113 2585 scope.go:117] "RemoveContainer" containerID="21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17" Jul 20 16:30:27.752361 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:30:27.752344 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17\": container with ID starting with 21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17 not found: ID does not exist" containerID="21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17" Jul 20 16:30:27.752408 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.752365 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17"} err="failed to get container status \"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17\": rpc error: code = NotFound desc = could not find container \"21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17\": container with ID starting with 21ce489dc2405f18e584f19d28524ee69c960d860cfaebc52a7e5ac9146c6f17 not found: ID does not exist" Jul 20 16:30:27.757051 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.757024 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:30:27.764378 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:27.764349 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-af2b09-openshift-default-b75c9d44f-297z7"] Jul 20 16:30:29.540905 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:29.540871 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" path="/var/lib/kubelet/pods/9a2a71bd-5032-4084-909f-0fce411405d1/volumes" Jul 20 16:30:30.604033 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.603991 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:30:30.813907 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.813878 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:30:30.814268 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814255 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.814318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814270 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.814318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814290 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.814318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814296 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.814318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814311 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:30.814318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814316 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62e49a7-18d1-4442-a671-c0f03e31ac58" containerName="istio-proxy" Jul 20 16:30:30.814475 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814372 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.814475 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.814380 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2a71bd-5032-4084-909f-0fce411405d1" containerName="istio-proxy" Jul 20 16:30:30.817492 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.817465 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.820234 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.820214 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-02789d-openshift-default-dockercfg-jzwxh\"" Jul 20 16:30:30.831524 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.831499 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:30:30.981111 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981073 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981123 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981217 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981242 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981312 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981327 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:30.981590 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:30.981351 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lng\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082653 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082618 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lng\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082759 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.082847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083145 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082860 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083145 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082893 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083145 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082931 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083145 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.082984 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083145 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.083024 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.083295 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083479 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.083468 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.083592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.083550 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.084970 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.084947 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.085409 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.085393 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.091343 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.091319 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.091445 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.091351 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lng\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng\") pod \"e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.128383 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.128351 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:31.294464 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.294435 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:30:31.296550 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:30:31.296525 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14d44aa_5fc8_4faa_8855_f5aa02285880.slice/crio-7c43f393a8f51cd97032adb95c455e1717bb2efe7eb4824b3a377610862c5eee WatchSource:0}: Error finding container 7c43f393a8f51cd97032adb95c455e1717bb2efe7eb4824b3a377610862c5eee: Status 404 returned error can't find the container with id 7c43f393a8f51cd97032adb95c455e1717bb2efe7eb4824b3a377610862c5eee Jul 20 16:30:31.298588 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.298553 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:31.298681 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.298618 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:31.298681 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.298645 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:31.763572 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.763524 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerStarted","Data":"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab"} Jul 20 16:30:31.764089 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.763604 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerStarted","Data":"7c43f393a8f51cd97032adb95c455e1717bb2efe7eb4824b3a377610862c5eee"} Jul 20 16:30:31.784234 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:31.784179 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podStartSLOduration=1.784135064 podStartE2EDuration="1.784135064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:30:31.783131642 +0000 UTC m=+2408.729587296" watchObservedRunningTime="2026-07-20 16:30:31.784135064 +0000 UTC m=+2408.730590719" Jul 20 16:30:32.129497 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:32.129463 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:32.134496 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:32.134469 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:32.771093 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:32.771055 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:32.772103 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:32.772085 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:38.808680 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.808648 2585 generic.go:356] "Generic (PLEG): container finished" podID="827c4387-9d59-4c16-89c3-284bc638e947" containerID="adbd2831c9c4a201f1fc8d9a73c8457273be2aa671c622fff7b585f4e55a6219" exitCode=0 Jul 20 16:30:38.809124 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.808721 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerDied","Data":"adbd2831c9c4a201f1fc8d9a73c8457273be2aa671c622fff7b585f4e55a6219"} Jul 20 16:30:38.809124 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.809093 2585 scope.go:117] "RemoveContainer" containerID="adbd2831c9c4a201f1fc8d9a73c8457273be2aa671c622fff7b585f4e55a6219" Jul 20 16:30:38.810090 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.810063 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:38.810214 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.810124 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:38.810214 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:38.810178 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:39.712366 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:39.712318 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:39.816675 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:39.816635 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerStarted","Data":"0cee37b91ed54a5a6f3846ca9685bc3789f3395e21bf74b17929bcac05a580bc"} Jul 20 16:30:40.378933 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:40.378885 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:40.380229 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:40.380199 2585 patch_prober.go:28] interesting pod/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 16:30:40.380467 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:40.380441 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 16:30:41.378297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:41.378253 2585 patch_prober.go:28] interesting pod/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 16:30:41.378901 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:41.378867 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 16:30:42.378763 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:42.378720 2585 patch_prober.go:28] interesting pod/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 16:30:42.379472 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:42.379440 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 16:30:43.378907 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:43.378856 2585 patch_prober.go:28] interesting pod/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 20 16:30:43.379472 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:43.378928 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 20 16:30:44.383604 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:44.383571 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:44.384005 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:44.383975 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:44.384718 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:44.384702 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:30:46.193895 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.193806 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:30:46.860802 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.860719 2585 generic.go:356] "Generic (PLEG): container finished" podID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerID="25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab" exitCode=0 Jul 20 16:30:46.860802 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.860767 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerDied","Data":"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab"} Jul 20 16:30:46.861201 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.861185 2585 scope.go:117] "RemoveContainer" containerID="25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab" Jul 20 16:30:46.862194 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.862146 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:46.862304 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.862251 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:46.862304 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:46.862298 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 20 16:30:47.771904 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:47.771867 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:47.872404 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:47.872369 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerStarted","Data":"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd"} Jul 20 16:30:48.129073 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:48.128982 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:48.130247 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:48.130222 2585 patch_prober.go:28] interesting pod/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 16:30:48.130364 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:48.130272 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 16:30:49.128875 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:49.128835 2585 patch_prober.go:28] interesting pod/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 16:30:49.129426 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:49.128902 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 16:30:50.129176 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:50.129115 2585 patch_prober.go:28] interesting pod/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 16:30:50.129578 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:50.129212 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 16:30:51.129020 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:51.128983 2585 patch_prober.go:28] interesting pod/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 20 16:30:51.129237 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:51.129037 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 20 16:30:52.133499 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:52.133466 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:52.133930 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:52.133747 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:52.134435 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:52.134413 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:30:59.604379 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:30:59.604346 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:31:12.904926 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:31:12.904883 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:31:32.005732 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:31:32.005700 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:31:49.398393 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:31:49.398353 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:32:07.401128 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:32:07.401083 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:32:21.902495 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:32:21.902402 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:32:41.103841 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:32:41.103804 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:33:00.896994 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:33:00.896955 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:33:19.996275 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:33:19.996236 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:33:36.800358 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:33:36.800318 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:33:49.900902 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:33:49.900822 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:34:11.698923 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:34:11.698887 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:34:29.602171 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:34:29.602112 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:34:48.304837 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:34:48.304799 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:35:13.099696 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:13.099664 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:35:23.746338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:23.746274 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:35:23.751444 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:23.751424 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:35:23.797780 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:23.797749 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:35:23.803419 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:23.803393 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgj6v_dad3ef21-b04e-4226-a03c-a151dd3fd47c/ovn-acl-logging/0.log" Jul 20 16:35:30.902792 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:30.902758 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:35:47.298200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:47.298151 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:35:55.355833 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.355797 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303573296"] Jul 20 16:35:55.359243 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.359226 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:55.361778 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.361755 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dzzm4\"" Jul 20 16:35:55.366449 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.366426 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303573296"] Jul 20 16:35:55.489498 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.489450 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmnn\" (UniqueName: \"kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn\") pod \"test-curl-7509-140011303573296\" (UID: \"b0df959d-80fd-42f1-b0ae-46b108957470\") " pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:55.591023 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.590980 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmnn\" (UniqueName: \"kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn\") pod \"test-curl-7509-140011303573296\" (UID: \"b0df959d-80fd-42f1-b0ae-46b108957470\") " pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:55.599877 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.599851 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmnn\" (UniqueName: \"kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn\") pod \"test-curl-7509-140011303573296\" (UID: \"b0df959d-80fd-42f1-b0ae-46b108957470\") " pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:55.669576 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.669487 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:55.806460 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.806431 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303573296"] Jul 20 16:35:55.807996 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:35:55.807972 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0df959d_80fd_42f1_b0ae_46b108957470.slice/crio-5071a3620212a90fa8133aa96f18b1896491a2bfd9f92a26fe5dc3cd33ad2f95 WatchSource:0}: Error finding container 5071a3620212a90fa8133aa96f18b1896491a2bfd9f92a26fe5dc3cd33ad2f95: Status 404 returned error can't find the container with id 5071a3620212a90fa8133aa96f18b1896491a2bfd9f92a26fe5dc3cd33ad2f95 Jul 20 16:35:55.809401 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:55.809372 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:35:56.614828 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:56.614800 2585 generic.go:356] "Generic (PLEG): container finished" podID="b0df959d-80fd-42f1-b0ae-46b108957470" containerID="6b29d9f705739913ebcb7095822b160fa3360e469216c0cc852c521b6e6906a3" exitCode=0 Jul 20 16:35:56.615205 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:56.614881 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303573296" event={"ID":"b0df959d-80fd-42f1-b0ae-46b108957470","Type":"ContainerDied","Data":"6b29d9f705739913ebcb7095822b160fa3360e469216c0cc852c521b6e6906a3"} Jul 20 16:35:56.615205 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:56.614921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303573296" event={"ID":"b0df959d-80fd-42f1-b0ae-46b108957470","Type":"ContainerStarted","Data":"5071a3620212a90fa8133aa96f18b1896491a2bfd9f92a26fe5dc3cd33ad2f95"} Jul 20 16:35:57.761855 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.761825 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:57.798021 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.797988 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303573296_b0df959d-80fd-42f1-b0ae-46b108957470/test-curl-7509-140011303573296/0.log" Jul 20 16:35:57.821395 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.821357 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303573296"] Jul 20 16:35:57.825340 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.825311 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303573296"] Jul 20 16:35:57.913312 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.913227 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzmnn\" (UniqueName: \"kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn\") pod \"b0df959d-80fd-42f1-b0ae-46b108957470\" (UID: \"b0df959d-80fd-42f1-b0ae-46b108957470\") " Jul 20 16:35:57.915437 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.915408 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn" (OuterVolumeSpecName: "kube-api-access-qzmnn") pod "b0df959d-80fd-42f1-b0ae-46b108957470" (UID: "b0df959d-80fd-42f1-b0ae-46b108957470"). InnerVolumeSpecName "kube-api-access-qzmnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:35:57.952801 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.952763 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303764400"] Jul 20 16:35:57.953166 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.953142 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0df959d-80fd-42f1-b0ae-46b108957470" containerName="test-curl-7509-140011303573296" Jul 20 16:35:57.953219 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.953171 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0df959d-80fd-42f1-b0ae-46b108957470" containerName="test-curl-7509-140011303573296" Jul 20 16:35:57.953262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.953237 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0df959d-80fd-42f1-b0ae-46b108957470" containerName="test-curl-7509-140011303573296" Jul 20 16:35:57.955777 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.955761 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:35:57.963660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:57.963389 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303764400"] Jul 20 16:35:58.014857 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.014823 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzmnn\" (UniqueName: \"kubernetes.io/projected/b0df959d-80fd-42f1-b0ae-46b108957470-kube-api-access-qzmnn\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:35:58.115773 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.115741 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvxz\" (UniqueName: \"kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz\") pod \"test-curl-7509-140011303764400\" (UID: \"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd\") " pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:35:58.216543 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.216508 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvxz\" (UniqueName: \"kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz\") pod \"test-curl-7509-140011303764400\" (UID: \"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd\") " pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:35:58.225711 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.225678 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvxz\" (UniqueName: \"kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz\") pod \"test-curl-7509-140011303764400\" (UID: \"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd\") " pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:35:58.267431 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.267399 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:35:58.406737 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.406709 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303764400"] Jul 20 16:35:58.408020 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:35:58.407989 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46aa1fd4_2cdd_4367_98f1_6c8e7bb723dd.slice/crio-3f5c6680949bbd6c8004f147c03a2fc75bb9994e81dc7cb2263da4845760db9e WatchSource:0}: Error finding container 3f5c6680949bbd6c8004f147c03a2fc75bb9994e81dc7cb2263da4845760db9e: Status 404 returned error can't find the container with id 3f5c6680949bbd6c8004f147c03a2fc75bb9994e81dc7cb2263da4845760db9e Jul 20 16:35:58.626495 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.626398 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303764400" event={"ID":"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd","Type":"ContainerStarted","Data":"3f5c6680949bbd6c8004f147c03a2fc75bb9994e81dc7cb2263da4845760db9e"} Jul 20 16:35:58.627719 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.627698 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:58.627824 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:58.627742 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5071a3620212a90fa8133aa96f18b1896491a2bfd9f92a26fe5dc3cd33ad2f95" Jul 20 16:35:58.638605 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:35:58.638575 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7509-140011303573296\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="b0df959d-80fd-42f1-b0ae-46b108957470" pod="opendatahub/test-curl-7509-140011303573296" Jul 20 16:35:59.540798 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:59.540767 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0df959d-80fd-42f1-b0ae-46b108957470" path="/var/lib/kubelet/pods/b0df959d-80fd-42f1-b0ae-46b108957470/volumes" Jul 20 16:35:59.634734 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:59.634703 2585 generic.go:356] "Generic (PLEG): container finished" podID="46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" containerID="d6a1c819dfd60dee28923df478d92c60c85d0e8310e252079407cd9188eec0f5" exitCode=0 Jul 20 16:35:59.634911 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:35:59.634783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303764400" event={"ID":"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd","Type":"ContainerDied","Data":"d6a1c819dfd60dee28923df478d92c60c85d0e8310e252079407cd9188eec0f5"} Jul 20 16:36:00.786571 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.786547 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:36:00.806035 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.806008 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303764400_46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd/test-curl-7509-140011303764400/0.log" Jul 20 16:36:00.828707 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.828672 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303764400"] Jul 20 16:36:00.832682 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.832657 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303764400"] Jul 20 16:36:00.941975 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.941944 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtvxz\" (UniqueName: \"kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz\") pod \"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd\" (UID: \"46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd\") " Jul 20 16:36:00.944138 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.944113 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz" (OuterVolumeSpecName: "kube-api-access-wtvxz") pod "46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" (UID: "46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd"). InnerVolumeSpecName "kube-api-access-wtvxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:00.986909 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.986870 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:00.987344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.987325 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" containerName="test-curl-7509-140011303764400" Jul 20 16:36:00.987444 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.987347 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" containerName="test-curl-7509-140011303764400" Jul 20 16:36:00.987501 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.987454 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" containerName="test-curl-7509-140011303764400" Jul 20 16:36:00.991235 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.991209 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:00.998601 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:00.998575 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:01.042813 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.042772 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtvxz\" (UniqueName: \"kubernetes.io/projected/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd-kube-api-access-wtvxz\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:01.143250 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.143211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6kf\" (UniqueName: \"kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf\") pod \"test-curl-7509-140011303546928\" (UID: \"8cfa3eed-a389-403d-8446-307f86c90949\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:01.244404 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.244311 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6kf\" (UniqueName: \"kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf\") pod \"test-curl-7509-140011303546928\" (UID: \"8cfa3eed-a389-403d-8446-307f86c90949\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:01.252706 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.252671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6kf\" (UniqueName: \"kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf\") pod \"test-curl-7509-140011303546928\" (UID: \"8cfa3eed-a389-403d-8446-307f86c90949\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:01.303347 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.303315 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:01.437100 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.437066 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:01.437243 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:36:01.437104 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cfa3eed_a389_403d_8446_307f86c90949.slice/crio-5270ade888eb570c679759de222feec17afb3048ce7a5ae11c011736d7c8dc14 WatchSource:0}: Error finding container 5270ade888eb570c679759de222feec17afb3048ce7a5ae11c011736d7c8dc14: Status 404 returned error can't find the container with id 5270ade888eb570c679759de222feec17afb3048ce7a5ae11c011736d7c8dc14 Jul 20 16:36:01.541436 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.541358 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd" path="/var/lib/kubelet/pods/46aa1fd4-2cdd-4367-98f1-6c8e7bb723dd/volumes" Jul 20 16:36:01.648698 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.648669 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303764400" Jul 20 16:36:01.648698 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.648686 2585 scope.go:117] "RemoveContainer" containerID="d6a1c819dfd60dee28923df478d92c60c85d0e8310e252079407cd9188eec0f5" Jul 20 16:36:01.650174 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:01.650122 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303546928" event={"ID":"8cfa3eed-a389-403d-8446-307f86c90949","Type":"ContainerStarted","Data":"5270ade888eb570c679759de222feec17afb3048ce7a5ae11c011736d7c8dc14"} Jul 20 16:36:02.657549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:02.657517 2585 generic.go:356] "Generic (PLEG): container finished" podID="8cfa3eed-a389-403d-8446-307f86c90949" containerID="e826d18c677c644f7baf362e424f774b1d94639ee9ca2cbc511157783b0ad3a9" exitCode=0 Jul 20 16:36:02.657932 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:02.657595 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303546928" event={"ID":"8cfa3eed-a389-403d-8446-307f86c90949","Type":"ContainerDied","Data":"e826d18c677c644f7baf362e424f774b1d94639ee9ca2cbc511157783b0ad3a9"} Jul 20 16:36:03.806076 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.806051 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:03.825091 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.825014 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303546928_8cfa3eed-a389-403d-8446-307f86c90949/test-curl-7509-140011303546928/0.log" Jul 20 16:36:03.846526 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.846493 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:03.849610 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.849585 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:03.967297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.967261 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:03.967640 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.967628 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cfa3eed-a389-403d-8446-307f86c90949" containerName="test-curl-7509-140011303546928" Jul 20 16:36:03.967685 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.967642 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cfa3eed-a389-403d-8446-307f86c90949" containerName="test-curl-7509-140011303546928" Jul 20 16:36:03.967737 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.967728 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cfa3eed-a389-403d-8446-307f86c90949" containerName="test-curl-7509-140011303546928" Jul 20 16:36:03.970035 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.970012 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp6kf\" (UniqueName: \"kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf\") pod \"8cfa3eed-a389-403d-8446-307f86c90949\" (UID: \"8cfa3eed-a389-403d-8446-307f86c90949\") " Jul 20 16:36:03.970730 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.970709 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:03.972098 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.972075 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf" (OuterVolumeSpecName: "kube-api-access-zp6kf") pod "8cfa3eed-a389-403d-8446-307f86c90949" (UID: "8cfa3eed-a389-403d-8446-307f86c90949"). InnerVolumeSpecName "kube-api-access-zp6kf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:03.976660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:03.976637 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:04.071660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.071624 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phng\" (UniqueName: \"kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng\") pod \"test-curl-7509-140011303546928\" (UID: \"ec162605-23de-4781-955b-da8978889614\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:04.071838 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.071749 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp6kf\" (UniqueName: \"kubernetes.io/projected/8cfa3eed-a389-403d-8446-307f86c90949-kube-api-access-zp6kf\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:04.172410 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.172376 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5phng\" (UniqueName: \"kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng\") pod \"test-curl-7509-140011303546928\" (UID: \"ec162605-23de-4781-955b-da8978889614\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:04.180113 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.180093 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phng\" (UniqueName: \"kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng\") pod \"test-curl-7509-140011303546928\" (UID: \"ec162605-23de-4781-955b-da8978889614\") " pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:04.289847 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.289757 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:04.428607 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.428582 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:04.429510 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:36:04.429485 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec162605_23de_4781_955b_da8978889614.slice/crio-6fde19746ce15b74626b0ab8640387fba2c8898e1a7d42dc9118127e8b69ac48 WatchSource:0}: Error finding container 6fde19746ce15b74626b0ab8640387fba2c8898e1a7d42dc9118127e8b69ac48: Status 404 returned error can't find the container with id 6fde19746ce15b74626b0ab8640387fba2c8898e1a7d42dc9118127e8b69ac48 Jul 20 16:36:04.671563 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.671482 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:04.671563 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.671520 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5270ade888eb570c679759de222feec17afb3048ce7a5ae11c011736d7c8dc14" Jul 20 16:36:04.672662 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.672630 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303546928" event={"ID":"ec162605-23de-4781-955b-da8978889614","Type":"ContainerStarted","Data":"6fde19746ce15b74626b0ab8640387fba2c8898e1a7d42dc9118127e8b69ac48"} Jul 20 16:36:04.682831 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:04.682803 2585 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7509-140011303546928" oldPodUID="8cfa3eed-a389-403d-8446-307f86c90949" podUID="ec162605-23de-4781-955b-da8978889614" Jul 20 16:36:05.542139 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:05.542098 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cfa3eed-a389-403d-8446-307f86c90949" path="/var/lib/kubelet/pods/8cfa3eed-a389-403d-8446-307f86c90949/volumes" Jul 20 16:36:05.680129 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:05.680093 2585 generic.go:356] "Generic (PLEG): container finished" podID="ec162605-23de-4781-955b-da8978889614" containerID="95004b8d901c60933327faa696ff96a1026d6c781079acc2a0a3c921e64bcab2" exitCode=0 Jul 20 16:36:05.680343 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:05.680187 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303546928" event={"ID":"ec162605-23de-4781-955b-da8978889614","Type":"ContainerDied","Data":"95004b8d901c60933327faa696ff96a1026d6c781079acc2a0a3c921e64bcab2"} Jul 20 16:36:06.496337 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.496304 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:36:06.829141 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.829117 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:06.850212 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.850184 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303546928_ec162605-23de-4781-955b-da8978889614/test-curl-7509-140011303546928/0.log" Jul 20 16:36:06.873416 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.873387 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:06.878143 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.878116 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303546928"] Jul 20 16:36:06.999401 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:06.999369 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5phng\" (UniqueName: \"kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng\") pod \"ec162605-23de-4781-955b-da8978889614\" (UID: \"ec162605-23de-4781-955b-da8978889614\") " Jul 20 16:36:07.001647 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.001557 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng" (OuterVolumeSpecName: "kube-api-access-5phng") pod "ec162605-23de-4781-955b-da8978889614" (UID: "ec162605-23de-4781-955b-da8978889614"). InnerVolumeSpecName "kube-api-access-5phng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:07.003916 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.003895 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:07.004297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.004284 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec162605-23de-4781-955b-da8978889614" containerName="test-curl-7509-140011303546928" Jul 20 16:36:07.004337 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.004299 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec162605-23de-4781-955b-da8978889614" containerName="test-curl-7509-140011303546928" Jul 20 16:36:07.004375 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.004366 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec162605-23de-4781-955b-da8978889614" containerName="test-curl-7509-140011303546928" Jul 20 16:36:07.007259 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.007244 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:07.012457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.012432 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:07.100435 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.100334 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwl6l\" (UniqueName: \"kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l\") pod \"test-curl-7509-140011303564320\" (UID: \"1e9e0589-7891-4ce4-9005-c9182880cc72\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:07.100582 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.100499 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5phng\" (UniqueName: \"kubernetes.io/projected/ec162605-23de-4781-955b-da8978889614-kube-api-access-5phng\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:07.201533 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.201490 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwl6l\" (UniqueName: \"kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l\") pod \"test-curl-7509-140011303564320\" (UID: \"1e9e0589-7891-4ce4-9005-c9182880cc72\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:07.210893 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.210863 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwl6l\" (UniqueName: \"kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l\") pod \"test-curl-7509-140011303564320\" (UID: \"1e9e0589-7891-4ce4-9005-c9182880cc72\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:07.318694 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.318658 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:07.454567 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.454538 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:07.456000 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:36:07.455977 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e9e0589_7891_4ce4_9005_c9182880cc72.slice/crio-7a65fabc4e1a2276910481a4c5967b932db06b4da1827f9866338caeb11787e9 WatchSource:0}: Error finding container 7a65fabc4e1a2276910481a4c5967b932db06b4da1827f9866338caeb11787e9: Status 404 returned error can't find the container with id 7a65fabc4e1a2276910481a4c5967b932db06b4da1827f9866338caeb11787e9 Jul 20 16:36:07.542031 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.542000 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec162605-23de-4781-955b-da8978889614" path="/var/lib/kubelet/pods/ec162605-23de-4781-955b-da8978889614/volumes" Jul 20 16:36:07.693330 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.693298 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303564320" event={"ID":"1e9e0589-7891-4ce4-9005-c9182880cc72","Type":"ContainerStarted","Data":"7a65fabc4e1a2276910481a4c5967b932db06b4da1827f9866338caeb11787e9"} Jul 20 16:36:07.694510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.694480 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303546928" Jul 20 16:36:07.694641 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:07.694494 2585 scope.go:117] "RemoveContainer" containerID="95004b8d901c60933327faa696ff96a1026d6c781079acc2a0a3c921e64bcab2" Jul 20 16:36:08.701833 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:08.701796 2585 generic.go:356] "Generic (PLEG): container finished" podID="1e9e0589-7891-4ce4-9005-c9182880cc72" containerID="e2aa325cbf9f1f3d5239218642a7ec0c9cb9f72f2ed72f917db3d04814af13ce" exitCode=0 Jul 20 16:36:08.702262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:08.701878 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303564320" event={"ID":"1e9e0589-7891-4ce4-9005-c9182880cc72","Type":"ContainerDied","Data":"e2aa325cbf9f1f3d5239218642a7ec0c9cb9f72f2ed72f917db3d04814af13ce"} Jul 20 16:36:09.853822 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:09.853792 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:09.871726 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:09.871697 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303564320_1e9e0589-7891-4ce4-9005-c9182880cc72/test-curl-7509-140011303564320/0.log" Jul 20 16:36:09.894981 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:09.894942 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:09.902494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:09.902465 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:10.026734 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.026647 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwl6l\" (UniqueName: \"kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l\") pod \"1e9e0589-7891-4ce4-9005-c9182880cc72\" (UID: \"1e9e0589-7891-4ce4-9005-c9182880cc72\") " Jul 20 16:36:10.028737 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.028708 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l" (OuterVolumeSpecName: "kube-api-access-bwl6l") pod "1e9e0589-7891-4ce4-9005-c9182880cc72" (UID: "1e9e0589-7891-4ce4-9005-c9182880cc72"). InnerVolumeSpecName "kube-api-access-bwl6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:10.034760 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.034730 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:10.035369 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.035351 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9e0589-7891-4ce4-9005-c9182880cc72" containerName="test-curl-7509-140011303564320" Jul 20 16:36:10.035426 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.035373 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9e0589-7891-4ce4-9005-c9182880cc72" containerName="test-curl-7509-140011303564320" Jul 20 16:36:10.035505 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.035492 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9e0589-7891-4ce4-9005-c9182880cc72" containerName="test-curl-7509-140011303564320" Jul 20 16:36:10.038866 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.038845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.042186 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.042138 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:10.127667 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.127622 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glrb\" (UniqueName: \"kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb\") pod \"test-curl-7509-140011303564320\" (UID: \"87614e8d-c504-4487-9203-2f67d0a26877\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.127838 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.127771 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwl6l\" (UniqueName: \"kubernetes.io/projected/1e9e0589-7891-4ce4-9005-c9182880cc72-kube-api-access-bwl6l\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:10.228857 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.228816 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glrb\" (UniqueName: \"kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb\") pod \"test-curl-7509-140011303564320\" (UID: \"87614e8d-c504-4487-9203-2f67d0a26877\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.236980 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.236949 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glrb\" (UniqueName: \"kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb\") pod \"test-curl-7509-140011303564320\" (UID: \"87614e8d-c504-4487-9203-2f67d0a26877\") " pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.350590 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.350504 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.479956 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.479927 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:10.481798 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:36:10.481767 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87614e8d_c504_4487_9203_2f67d0a26877.slice/crio-e5631588299b2273a36d8aa656fed68ba875178a0cf5e7751918746a70a95fec WatchSource:0}: Error finding container e5631588299b2273a36d8aa656fed68ba875178a0cf5e7751918746a70a95fec: Status 404 returned error can't find the container with id e5631588299b2273a36d8aa656fed68ba875178a0cf5e7751918746a70a95fec Jul 20 16:36:10.715617 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.715578 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303564320" event={"ID":"87614e8d-c504-4487-9203-2f67d0a26877","Type":"ContainerStarted","Data":"e5631588299b2273a36d8aa656fed68ba875178a0cf5e7751918746a70a95fec"} Jul 20 16:36:10.716684 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.716665 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a65fabc4e1a2276910481a4c5967b932db06b4da1827f9866338caeb11787e9" Jul 20 16:36:10.716788 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.716693 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:10.727993 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:10.727968 2585 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7509-140011303564320" oldPodUID="1e9e0589-7891-4ce4-9005-c9182880cc72" podUID="87614e8d-c504-4487-9203-2f67d0a26877" Jul 20 16:36:11.541571 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:11.541533 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9e0589-7891-4ce4-9005-c9182880cc72" path="/var/lib/kubelet/pods/1e9e0589-7891-4ce4-9005-c9182880cc72/volumes" Jul 20 16:36:11.723458 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:11.723429 2585 generic.go:356] "Generic (PLEG): container finished" podID="87614e8d-c504-4487-9203-2f67d0a26877" containerID="4b87899267c58f234b9aa83360428e132725ad863d4fc6f0d772948ed99c79ae" exitCode=0 Jul 20 16:36:11.723605 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:11.723511 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-140011303564320" event={"ID":"87614e8d-c504-4487-9203-2f67d0a26877","Type":"ContainerDied","Data":"4b87899267c58f234b9aa83360428e132725ad863d4fc6f0d772948ed99c79ae"} Jul 20 16:36:12.864254 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:12.864231 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:12.885230 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:12.885200 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-140011303564320_87614e8d-c504-4487-9203-2f67d0a26877/test-curl-7509-140011303564320/0.log" Jul 20 16:36:12.905868 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:12.905832 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:12.910688 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:12.910663 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-140011303564320"] Jul 20 16:36:13.051549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.051452 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glrb\" (UniqueName: \"kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb\") pod \"87614e8d-c504-4487-9203-2f67d0a26877\" (UID: \"87614e8d-c504-4487-9203-2f67d0a26877\") " Jul 20 16:36:13.053657 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.053634 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb" (OuterVolumeSpecName: "kube-api-access-5glrb") pod "87614e8d-c504-4487-9203-2f67d0a26877" (UID: "87614e8d-c504-4487-9203-2f67d0a26877"). InnerVolumeSpecName "kube-api-access-5glrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:13.152835 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.152799 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glrb\" (UniqueName: \"kubernetes.io/projected/87614e8d-c504-4487-9203-2f67d0a26877-kube-api-access-5glrb\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:13.542001 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.541962 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87614e8d-c504-4487-9203-2f67d0a26877" path="/var/lib/kubelet/pods/87614e8d-c504-4487-9203-2f67d0a26877/volumes" Jul 20 16:36:13.736298 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.736269 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-140011303564320" Jul 20 16:36:13.736483 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:13.736310 2585 scope.go:117] "RemoveContainer" containerID="4b87899267c58f234b9aa83360428e132725ad863d4fc6f0d772948ed99c79ae" Jul 20 16:36:25.992415 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:25.992374 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:36:34.683860 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:34.683824 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:36:34.684469 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:34.684027 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" containerID="cri-o://0cee37b91ed54a5a6f3846ca9685bc3789f3395e21bf74b17929bcac05a580bc" gracePeriod=30 Jul 20 16:36:39.890749 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:39.890711 2585 generic.go:356] "Generic (PLEG): container finished" podID="827c4387-9d59-4c16-89c3-284bc638e947" containerID="0cee37b91ed54a5a6f3846ca9685bc3789f3395e21bf74b17929bcac05a580bc" exitCode=0 Jul 20 16:36:39.891142 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:39.890783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerDied","Data":"0cee37b91ed54a5a6f3846ca9685bc3789f3395e21bf74b17929bcac05a580bc"} Jul 20 16:36:39.891142 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:39.890844 2585 scope.go:117] "RemoveContainer" containerID="adbd2831c9c4a201f1fc8d9a73c8457273be2aa671c622fff7b585f4e55a6219" Jul 20 16:36:39.947672 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:39.947618 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:36:40.095494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095458 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095515 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095531 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095549 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095574 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095617 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.095690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095651 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.096024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095693 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.096024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095745 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5597\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597\") pod \"827c4387-9d59-4c16-89c3-284bc638e947\" (UID: \"827c4387-9d59-4c16-89c3-284bc638e947\") " Jul 20 16:36:40.096024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095802 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:36:40.096024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095827 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:36:40.096024 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.095949 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:36:40.096318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.096093 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:36:40.096318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.096214 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/827c4387-9d59-4c16-89c3-284bc638e947-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.096318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.096237 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.096318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.096252 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.096978 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.096954 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data" (OuterVolumeSpecName: "istio-data") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:36:40.098015 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.097990 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597" (OuterVolumeSpecName: "kube-api-access-s5597") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "kube-api-access-s5597". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:40.098113 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.098034 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token" (OuterVolumeSpecName: "istio-token") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:36:40.098295 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.098277 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:36:40.098360 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.098289 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "827c4387-9d59-4c16-89c3-284bc638e947" (UID: "827c4387-9d59-4c16-89c3-284bc638e947"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:36:40.196879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196835 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.196879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196872 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.196879 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196884 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/827c4387-9d59-4c16-89c3-284bc638e947-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.197126 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196895 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.197126 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196909 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/827c4387-9d59-4c16-89c3-284bc638e947-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.197126 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.196920 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5597\" (UniqueName: \"kubernetes.io/projected/827c4387-9d59-4c16-89c3-284bc638e947-kube-api-access-s5597\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:36:40.898009 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.897970 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" event={"ID":"827c4387-9d59-4c16-89c3-284bc638e947","Type":"ContainerDied","Data":"21da0e18e203aaaebfe64a15d651e971b9de0feb415a10e453762c1d5c06e0c1"} Jul 20 16:36:40.898009 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.898008 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8" Jul 20 16:36:40.898503 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.898030 2585 scope.go:117] "RemoveContainer" containerID="0cee37b91ed54a5a6f3846ca9685bc3789f3395e21bf74b17929bcac05a580bc" Jul 20 16:36:40.923230 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.923198 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:36:40.926732 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:40.926704 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-329d3d-openshift-default-55b7cd797f-kclf8"] Jul 20 16:36:41.541117 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:41.541088 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="827c4387-9d59-4c16-89c3-284bc638e947" path="/var/lib/kubelet/pods/827c4387-9d59-4c16-89c3-284bc638e947/volumes" Jul 20 16:36:48.209463 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:48.209373 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-92hvm"] Jul 20 16:36:57.117431 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:57.117396 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:36:57.117875 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:57.117623 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" containerID="cri-o://aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd" gracePeriod=30 Jul 20 16:36:57.776715 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:36:57.776678 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d65d7f4d-fr72g_69ce1f3d-eed1-49f0-9d53-0b7a0c87c287/authorino/0.log" Jul 20 16:37:02.382677 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.382616 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:37:02.399226 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399195 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399245 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399273 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82lng\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399337 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399365 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399364 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399393 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399451 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399483 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.399592 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399516 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert\") pod \"c14d44aa-5fc8-4faa-8855-f5aa02285880\" (UID: \"c14d44aa-5fc8-4faa-8855-f5aa02285880\") " Jul 20 16:37:02.400195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.399885 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:02.400195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.400049 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:02.400195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.400106 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:37:02.400195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.400145 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:02.400478 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.400357 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data" (OuterVolumeSpecName: "istio-data") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:02.401539 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.401507 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token" (OuterVolumeSpecName: "istio-token") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:02.401681 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.401661 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:37:02.401823 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.401808 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng" (OuterVolumeSpecName: "kube-api-access-82lng") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "kube-api-access-82lng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:37:02.401913 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.401897 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c14d44aa-5fc8-4faa-8855-f5aa02285880" (UID: "c14d44aa-5fc8-4faa-8855-f5aa02285880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 20 16:37:02.500747 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500714 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500747 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500743 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500747 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500752 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c14d44aa-5fc8-4faa-8855-f5aa02285880-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500761 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500769 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500778 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82lng\" (UniqueName: \"kubernetes.io/projected/c14d44aa-5fc8-4faa-8855-f5aa02285880-kube-api-access-82lng\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500787 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500795 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:02.500987 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:02.500802 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c14d44aa-5fc8-4faa-8855-f5aa02285880-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 20 16:37:03.025517 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.025487 2585 generic.go:356] "Generic (PLEG): container finished" podID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerID="aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd" exitCode=0 Jul 20 16:37:03.025708 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.025539 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerDied","Data":"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd"} Jul 20 16:37:03.025708 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.025544 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" Jul 20 16:37:03.025708 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.025584 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf" event={"ID":"c14d44aa-5fc8-4faa-8855-f5aa02285880","Type":"ContainerDied","Data":"7c43f393a8f51cd97032adb95c455e1717bb2efe7eb4824b3a377610862c5eee"} Jul 20 16:37:03.025708 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.025606 2585 scope.go:117] "RemoveContainer" containerID="aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd" Jul 20 16:37:03.035344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.035324 2585 scope.go:117] "RemoveContainer" containerID="25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab" Jul 20 16:37:03.043899 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.043879 2585 scope.go:117] "RemoveContainer" containerID="aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd" Jul 20 16:37:03.044147 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:37:03.044128 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd\": container with ID starting with aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd not found: ID does not exist" containerID="aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd" Jul 20 16:37:03.044202 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.044173 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd"} err="failed to get container status \"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd\": rpc error: code = NotFound desc = could not find container \"aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd\": container with ID starting with aa2a2f719c237e5852701ad1e119500eebb4094e034d00f47d15757e25bdb6fd not found: ID does not exist" Jul 20 16:37:03.044202 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.044191 2585 scope.go:117] "RemoveContainer" containerID="25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab" Jul 20 16:37:03.044435 ip-10-0-138-33 kubenswrapper[2585]: E0720 16:37:03.044418 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab\": container with ID starting with 25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab not found: ID does not exist" containerID="25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab" Jul 20 16:37:03.044475 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.044442 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab"} err="failed to get container status \"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab\": rpc error: code = NotFound desc = could not find container \"25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab\": container with ID starting with 25c8abce383f247808dbbba2b03b3be58f51fb75365ed28a2a1cd9e62d5f8bab not found: ID does not exist" Jul 20 16:37:03.052713 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.052690 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:37:03.062318 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.062289 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-02789d-openshift-default-5f898c546c-5xgmf"] Jul 20 16:37:03.517286 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.517255 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qcn6_e58ea023-1319-46f7-aec7-487f17308e0b/server/0.log" Jul 20 16:37:03.540457 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.540430 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" path="/var/lib/kubelet/pods/c14d44aa-5fc8-4faa-8855-f5aa02285880/volumes" Jul 20 16:37:03.629746 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.629715 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5ntpd_156913d7-647c-4132-aa8b-4828c9333d21/manager/0.log" Jul 20 16:37:03.877180 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.877069 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b76897bc6-h4c65_b47a53da-299a-477a-aa31-7abe3d07d344/copy-manifests/0.log" Jul 20 16:37:03.883210 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:03.883190 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b76897bc6-h4c65_b47a53da-299a-477a-aa31-7abe3d07d344/manager/0.log" Jul 20 16:37:05.546549 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.546523 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/util/0.log" Jul 20 16:37:05.554298 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.554281 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/pull/0.log" Jul 20 16:37:05.559700 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.559683 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/extract/0.log" Jul 20 16:37:05.666892 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.666864 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/util/0.log" Jul 20 16:37:05.673107 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.673084 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/pull/0.log" Jul 20 16:37:05.678200 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.678181 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/extract/0.log" Jul 20 16:37:05.794027 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.794001 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/util/0.log" Jul 20 16:37:05.801207 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.801134 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/pull/0.log" Jul 20 16:37:05.807828 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.807811 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/extract/0.log" Jul 20 16:37:05.925538 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.925512 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/util/0.log" Jul 20 16:37:05.932387 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.932359 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/pull/0.log" Jul 20 16:37:05.939595 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:05.939571 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/extract/0.log" Jul 20 16:37:06.058836 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.058754 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d65d7f4d-fr72g_69ce1f3d-eed1-49f0-9d53-0b7a0c87c287/authorino/0.log" Jul 20 16:37:06.291767 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.291736 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-52jtv_9ac1e0d4-30b5-4102-b4d3-492c17221b46/manager/0.log" Jul 20 16:37:06.402588 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.402515 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjbzk_d542ee88-20e4-4a70-b1df-4ce553bfdd1d/kuadrant-console-plugin/0.log" Jul 20 16:37:06.512974 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.512944 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kf2dg_bfa217b9-ef60-44f5-ae91-31f103e973cb/registry-server/0.log" Jul 20 16:37:06.632458 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.632431 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jgwpz_f7bff018-8562-40fd-af37-da52e759fb92/manager/0.log" Jul 20 16:37:06.779669 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:06.779634 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-92hvm_2b471cd3-2ccd-46a6-83e6-8c31016c3ea1/limitador/0.log" Jul 20 16:37:07.254829 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:07.254801 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gq5vw_fe3a02a7-67b5-4af9-9427-c5eba5feb50d/istio-proxy/0.log" Jul 20 16:37:07.735943 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:07.735913 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/1.log" Jul 20 16:37:08.104755 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:08.104681 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59bf898cc6-pfftd_b91d4e70-7530-4d0d-bb98-975cff1b2e25/router/0.log" Jul 20 16:37:14.645931 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.645891 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q8qg5/must-gather-kfjck"] Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646271 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646283 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646291 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87614e8d-c504-4487-9203-2f67d0a26877" containerName="test-curl-7509-140011303564320" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646297 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="87614e8d-c504-4487-9203-2f67d0a26877" containerName="test-curl-7509-140011303564320" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646307 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646312 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646324 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646329 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646337 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.646338 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646343 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.646643 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646405 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.646643 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646413 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="87614e8d-c504-4487-9203-2f67d0a26877" containerName="test-curl-7509-140011303564320" Jul 20 16:37:14.646643 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646423 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646643 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646429 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="827c4387-9d59-4c16-89c3-284bc638e947" containerName="istio-proxy" Jul 20 16:37:14.646643 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.646551 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14d44aa-5fc8-4faa-8855-f5aa02285880" containerName="istio-proxy" Jul 20 16:37:14.649414 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.649396 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.652651 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.652630 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q8qg5\"/\"kube-root-ca.crt\"" Jul 20 16:37:14.653683 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.653637 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q8qg5\"/\"default-dockercfg-4bfpg\"" Jul 20 16:37:14.653683 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.653671 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q8qg5\"/\"openshift-service-ca.crt\"" Jul 20 16:37:14.657873 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.657847 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qg5/must-gather-kfjck"] Jul 20 16:37:14.712480 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.712449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/155b0c2d-db82-4d0b-a512-76b17d14153d-must-gather-output\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.712646 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.712571 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxst\" (UniqueName: \"kubernetes.io/projected/155b0c2d-db82-4d0b-a512-76b17d14153d-kube-api-access-qxxst\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.814014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.813975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxst\" (UniqueName: \"kubernetes.io/projected/155b0c2d-db82-4d0b-a512-76b17d14153d-kube-api-access-qxxst\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.814240 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.814025 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/155b0c2d-db82-4d0b-a512-76b17d14153d-must-gather-output\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.814392 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.814373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/155b0c2d-db82-4d0b-a512-76b17d14153d-must-gather-output\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.823013 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.822992 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxst\" (UniqueName: \"kubernetes.io/projected/155b0c2d-db82-4d0b-a512-76b17d14153d-kube-api-access-qxxst\") pod \"must-gather-kfjck\" (UID: \"155b0c2d-db82-4d0b-a512-76b17d14153d\") " pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:14.959900 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:14.959864 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qg5/must-gather-kfjck" Jul 20 16:37:15.104402 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:15.104374 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qg5/must-gather-kfjck"] Jul 20 16:37:15.106467 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:37:15.106435 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod155b0c2d_db82_4d0b_a512_76b17d14153d.slice/crio-ae8ab57a0730c55152c047f96fd35c0561cf5a43fe754c2dad2e90e8db2441e7 WatchSource:0}: Error finding container ae8ab57a0730c55152c047f96fd35c0561cf5a43fe754c2dad2e90e8db2441e7: Status 404 returned error can't find the container with id ae8ab57a0730c55152c047f96fd35c0561cf5a43fe754c2dad2e90e8db2441e7 Jul 20 16:37:16.099238 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:16.099197 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qg5/must-gather-kfjck" event={"ID":"155b0c2d-db82-4d0b-a512-76b17d14153d","Type":"ContainerStarted","Data":"ae8ab57a0730c55152c047f96fd35c0561cf5a43fe754c2dad2e90e8db2441e7"} Jul 20 16:37:17.109870 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:17.109832 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qg5/must-gather-kfjck" event={"ID":"155b0c2d-db82-4d0b-a512-76b17d14153d","Type":"ContainerStarted","Data":"3e1724f93cd9b8eab59372e5f8a8dc3907c170ea0637633c33126c97eb2940f6"} Jul 20 16:37:17.110396 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:17.109884 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qg5/must-gather-kfjck" event={"ID":"155b0c2d-db82-4d0b-a512-76b17d14153d","Type":"ContainerStarted","Data":"5ed88d8e45637cbb7923e8d50a6b15ef48b79c38a35b6fa01b0c94d4be012c2e"} Jul 20 16:37:17.131744 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:17.131683 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q8qg5/must-gather-kfjck" podStartSLOduration=1.9067657310000001 podStartE2EDuration="3.131665016s" totalImagesPullingTime="1.224899285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:17.129642818 +0000 UTC m=+2814.076098490" watchObservedRunningTime="2026-07-20 16:37:17.131665016 +0000 UTC m=+2814.078120673" Jul 20 16:37:18.110767 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:18.110729 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6nfmm_bb63bde8-6d03-403d-8886-7b806aa6ca33/global-pull-secret-syncer/0.log" Jul 20 16:37:18.361660 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:18.361570 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-btmvz_f51da579-40b6-4cec-8c25-cfa7c6dafc91/konnectivity-agent/0.log" Jul 20 16:37:18.467475 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:18.467442 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-33.ec2.internal_31783b4ed77dfc64030a66f386750024/haproxy/0.log" Jul 20 16:37:23.044055 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.043985 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/extract/0.log" Jul 20 16:37:23.068116 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.068091 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/util/0.log" Jul 20 16:37:23.093226 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.093193 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v256g_125ebd04-3074-4b20-ade4-f1991008b1fa/pull/0.log" Jul 20 16:37:23.122657 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.122615 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/extract/0.log" Jul 20 16:37:23.157456 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.157431 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/util/0.log" Jul 20 16:37:23.177970 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.177941 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x78c2_b3bbe382-7449-47b7-9972-58e909795627/pull/0.log" Jul 20 16:37:23.211906 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.211878 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/extract/0.log" Jul 20 16:37:23.233883 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.233806 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/util/0.log" Jul 20 16:37:23.261273 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.261236 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b2cjw_21ae4455-2110-4046-8cc6-e1f01e960426/pull/0.log" Jul 20 16:37:23.295585 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.295506 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/extract/0.log" Jul 20 16:37:23.319934 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.319907 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/util/0.log" Jul 20 16:37:23.345510 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.345479 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16q4hb_0ba5f472-ec4b-4c19-b77c-78516b089e5e/pull/0.log" Jul 20 16:37:23.900174 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.899774 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d65d7f4d-fr72g_69ce1f3d-eed1-49f0-9d53-0b7a0c87c287/authorino/0.log" Jul 20 16:37:23.964296 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.964211 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-52jtv_9ac1e0d4-30b5-4102-b4d3-492c17221b46/manager/0.log" Jul 20 16:37:23.998547 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:23.998419 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjbzk_d542ee88-20e4-4a70-b1df-4ce553bfdd1d/kuadrant-console-plugin/0.log" Jul 20 16:37:24.042781 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:24.042743 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kf2dg_bfa217b9-ef60-44f5-ae91-31f103e973cb/registry-server/0.log" Jul 20 16:37:24.288175 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:24.288129 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jgwpz_f7bff018-8562-40fd-af37-da52e759fb92/manager/0.log" Jul 20 16:37:24.311031 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:24.310986 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-92hvm_2b471cd3-2ccd-46a6-83e6-8c31016c3ea1/limitador/0.log" Jul 20 16:37:26.327663 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:26.327619 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-84x4j_bd21cd47-381b-46af-993e-d5a24caba364/cluster-monitoring-operator/0.log" Jul 20 16:37:26.633265 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:26.633186 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l4vmg_57867bbd-0eeb-4125-85cd-86f6f9f99bd2/node-exporter/0.log" Jul 20 16:37:26.654707 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:26.654676 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l4vmg_57867bbd-0eeb-4125-85cd-86f6f9f99bd2/kube-rbac-proxy/0.log" Jul 20 16:37:26.674233 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:26.674208 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l4vmg_57867bbd-0eeb-4125-85cd-86f6f9f99bd2/init-textfile/0.log" Jul 20 16:37:27.012932 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:27.012867 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-q8zcb_132e3f29-1dcf-4ebd-9375-7c6b592735bc/prometheus-operator-admission-webhook/0.log" Jul 20 16:37:28.446105 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.446064 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn"] Jul 20 16:37:28.452262 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.452224 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.481041 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.480997 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn"] Jul 20 16:37:28.484297 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.484261 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-cq86n_fb3eedb9-77b7-4bf2-910b-6d60dab371b4/networking-console-plugin/0.log" Jul 20 16:37:28.561476 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.561433 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v5mv\" (UniqueName: \"kubernetes.io/projected/767e7808-f0aa-4bbd-abc6-f7e054af7537-kube-api-access-9v5mv\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.561678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.561493 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-sys\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.561678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.561531 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-proc\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.561678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.561555 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-podres\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.561678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.561595 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-lib-modules\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.663066 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.663006 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v5mv\" (UniqueName: \"kubernetes.io/projected/767e7808-f0aa-4bbd-abc6-f7e054af7537-kube-api-access-9v5mv\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.663325 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.663080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-sys\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.663325 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.663123 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-proc\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.663325 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.663144 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-podres\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.663325 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.663195 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-lib-modules\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.664344 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.664314 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-sys\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.664494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.664385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-proc\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.664494 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.664425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-podres\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.664602 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.664489 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/767e7808-f0aa-4bbd-abc6-f7e054af7537-lib-modules\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.674088 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.674047 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v5mv\" (UniqueName: \"kubernetes.io/projected/767e7808-f0aa-4bbd-abc6-f7e054af7537-kube-api-access-9v5mv\") pod \"perf-node-gather-daemonset-qfgqn\" (UID: \"767e7808-f0aa-4bbd-abc6-f7e054af7537\") " pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.764968 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.764863 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:28.964678 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:28.964232 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn"] Jul 20 16:37:28.966879 ip-10-0-138-33 kubenswrapper[2585]: W0720 16:37:28.966845 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod767e7808_f0aa_4bbd_abc6_f7e054af7537.slice/crio-526c16eee743f3cde461f1fd107ff558b8b90f0a0cb469aa0c726c7c9e5539c2 WatchSource:0}: Error finding container 526c16eee743f3cde461f1fd107ff558b8b90f0a0cb469aa0c726c7c9e5539c2: Status 404 returned error can't find the container with id 526c16eee743f3cde461f1fd107ff558b8b90f0a0cb469aa0c726c7c9e5539c2 Jul 20 16:37:29.181505 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.181478 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/2.log" Jul 20 16:37:29.186236 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.186206 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-822pj_204bc367-6913-4cfd-aec5-52555cba01b4/console-operator/3.log" Jul 20 16:37:29.216307 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.216261 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" event={"ID":"767e7808-f0aa-4bbd-abc6-f7e054af7537","Type":"ContainerStarted","Data":"5acee35617abdd178e821de0c718c572e2c18e28717e79e1fde193c3b1f8796a"} Jul 20 16:37:29.216504 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.216334 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" event={"ID":"767e7808-f0aa-4bbd-abc6-f7e054af7537","Type":"ContainerStarted","Data":"526c16eee743f3cde461f1fd107ff558b8b90f0a0cb469aa0c726c7c9e5539c2"} Jul 20 16:37:29.217173 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.217136 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:29.235784 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:29.235720 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" podStartSLOduration=1.235696443 podStartE2EDuration="1.235696443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:37:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:37:29.234590492 +0000 UTC m=+2826.181046148" watchObservedRunningTime="2026-07-20 16:37:29.235696443 +0000 UTC m=+2826.182152098" Jul 20 16:37:30.350873 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:30.350846 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-x2r22_61a9f7b8-1af0-4c94-85c1-e54ca0d9081b/volume-data-source-validator/0.log" Jul 20 16:37:31.539136 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:31.539104 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldhw9_9d4d0a46-8688-4312-9717-debba413e3c4/dns/0.log" Jul 20 16:37:31.568314 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:31.568281 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldhw9_9d4d0a46-8688-4312-9717-debba413e3c4/kube-rbac-proxy/0.log" Jul 20 16:37:31.654714 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:31.654688 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z99gh_ef623006-45c5-48e1-a7bf-463fc77a82ed/dns-node-resolver/0.log" Jul 20 16:37:32.374673 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:32.374643 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9td84_d6cfd7db-a1f8-4cd7-b99b-fca34c24987d/node-ca/0.log" Jul 20 16:37:33.559328 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:33.559290 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gq5vw_fe3a02a7-67b5-4af9-9427-c5eba5feb50d/istio-proxy/0.log" Jul 20 16:37:33.924014 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:33.923931 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/0.log" Jul 20 16:37:33.954959 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:33.954926 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/1.log" Jul 20 16:37:34.052103 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:34.052078 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59bf898cc6-pfftd_b91d4e70-7530-4d0d-bb98-975cff1b2e25/router/0.log" Jul 20 16:37:34.854922 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:34.854895 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx2pp_e5870db0-8958-4913-8a6f-e5e696ab35bf/serve-healthcheck-canary/0.log" Jul 20 16:37:35.490919 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:35.490887 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-zwcjg_9e4904ff-edd9-474d-abb9-08b494454108/insights-operator/0.log" Jul 20 16:37:35.491690 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:35.491674 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-zwcjg_9e4904ff-edd9-474d-abb9-08b494454108/insights-operator/1.log" Jul 20 16:37:35.544042 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:35.544014 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mzb9_4cd9209d-cee4-44c6-becf-1d64b0c6ef6a/kube-rbac-proxy/0.log" Jul 20 16:37:35.620241 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:35.620214 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mzb9_4cd9209d-cee4-44c6-becf-1d64b0c6ef6a/exporter/0.log" Jul 20 16:37:35.702140 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:35.702108 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mzb9_4cd9209d-cee4-44c6-becf-1d64b0c6ef6a/extractor/0.log" Jul 20 16:37:36.242667 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:36.242628 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q8qg5/perf-node-gather-daemonset-qfgqn" Jul 20 16:37:39.071195 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.071094 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gq5vw_fe3a02a7-67b5-4af9-9427-c5eba5feb50d/istio-proxy/0.log" Jul 20 16:37:39.092016 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.091988 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5qcn6_e58ea023-1319-46f7-aec7-487f17308e0b/server/0.log" Jul 20 16:37:39.166511 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.166481 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5ntpd_156913d7-647c-4132-aa8b-4828c9333d21/manager/0.log" Jul 20 16:37:39.382100 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.382008 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b76897bc6-h4c65_b47a53da-299a-477a-aa31-7abe3d07d344/manager/0.log" Jul 20 16:37:39.394601 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.394569 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/0.log" Jul 20 16:37:39.408968 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.408942 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b76897bc6-h4c65_b47a53da-299a-477a-aa31-7abe3d07d344/copy-manifests/0.log" Jul 20 16:37:39.425730 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.425697 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/1.log" Jul 20 16:37:39.490868 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:39.490831 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59bf898cc6-pfftd_b91d4e70-7530-4d0d-bb98-975cff1b2e25/router/0.log" Jul 20 16:37:40.781950 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:40.781914 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gq5vw_fe3a02a7-67b5-4af9-9427-c5eba5feb50d/istio-proxy/0.log" Jul 20 16:37:40.939816 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:40.939784 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8c9c5dcb7-mn95k_2f17a532-f24e-4e18-93e3-321d6e178518/manager/0.log" Jul 20 16:37:41.069047 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:41.069017 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/0.log" Jul 20 16:37:41.109203 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:41.109136 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-5t925_c2e9747c-5dd6-44c4-b1f1-4d59facfd449/istio-proxy/1.log" Jul 20 16:37:41.188433 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:41.188406 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59bf898cc6-pfftd_b91d4e70-7530-4d0d-bb98-975cff1b2e25/router/0.log" Jul 20 16:37:45.741083 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:45.741046 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sbgxt_ed7e7eeb-7ec5-4196-86cd-be5954a47462/migrator/0.log" Jul 20 16:37:45.763384 ip-10-0-138-33 kubenswrapper[2585]: I0720 16:37:45.763353 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sbgxt_ed7e7eeb-7ec5-4196-86cd-be5954a47462/graceful-termination/0.log"