Jul 14 07:50:05.249305 ip-10-0-128-86 systemd[1]: Starting Kubernetes Kubelet... Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 07:50:07.305378 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.304321 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310120 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310136 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310141 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310146 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310151 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310155 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310159 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310164 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310168 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310172 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310176 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310180 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310184 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310188 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310191 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310195 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310199 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310203 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310206 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.316671 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310210 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310215 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310219 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310227 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310231 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310235 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310239 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310243 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310247 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310251 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310256 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310260 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310264 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310270 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310275 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310281 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310285 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310289 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310293 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.317362 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310297 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310301 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310305 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310310 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310314 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310317 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310321 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310325 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310329 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310332 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310336 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310339 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310344 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310348 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310351 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310355 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310359 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310364 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310368 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310372 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.318689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310375 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310379 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310383 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310387 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310391 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310395 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310398 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310402 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310406 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310409 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310413 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310417 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310421 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310425 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310429 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310433 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310437 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310440 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310444 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.319350 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310448 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310451 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310455 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310458 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310462 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310466 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310470 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310499 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310523 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310532 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310538 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310541 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310545 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310552 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310554 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310559 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310563 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310568 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310574 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.320651 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310578 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310580 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.310586 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311516 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311526 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311529 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311533 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311537 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311540 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311545 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311548 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311551 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311556 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311559 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311562 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311565 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311570 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311572 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311575 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311580 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.321285 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311582 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311586 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311590 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311592 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311595 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311597 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311600 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311602 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311605 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311607 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311611 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311614 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311616 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311619 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311623 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311626 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311629 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311633 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311637 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311640 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.322712 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311643 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311648 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311650 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311653 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311658 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311661 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311664 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311666 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311671 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311673 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311676 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311678 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311682 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311685 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311688 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311690 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311695 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311697 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311700 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311702 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.323340 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311707 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311710 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311712 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311717 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311720 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311722 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311725 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311729 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311732 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311735 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311737 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311742 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311744 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311747 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311751 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311756 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311760 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311763 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311767 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.448041 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311771 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.391548 ip-10-0-128-86 systemd[1]: Started Kubernetes Kubelet. Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311775 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311780 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311782 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311786 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311792 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311811 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311816 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311819 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311822 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311826 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311829 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311831 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311836 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311839 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311841 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311844 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311848 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311850 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311853 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.448689 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311856 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311860 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.311863 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312345 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312351 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312356 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312359 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312362 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312366 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312370 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312372 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312377 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312380 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312382 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312385 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312389 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312392 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312394 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312397 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312401 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.449632 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312404 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312414 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312417 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312420 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312425 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312427 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312430 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312434 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312436 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312439 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312442 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312444 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312447 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312450 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312452 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312456 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312459 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312461 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312464 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312469 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.450323 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312471 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312475 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312480 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312483 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312485 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312488 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312494 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312497 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312501 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312507 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312511 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312517 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312520 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312531 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312534 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312537 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312541 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312544 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.451575 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312546 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312551 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312556 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312558 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312561 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312563 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312568 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312571 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312573 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312576 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312580 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312583 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312586 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312598 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312603 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312606 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312609 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312612 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312616 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312619 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.452195 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312622 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312625 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312629 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312632 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312634 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312637 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312641 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312644 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312649 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312652 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312654 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312656 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312659 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312664 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312666 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312669 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312673 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312675 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312678 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312680 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.453059 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312685 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312687 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312690 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.312693 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312783 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312792 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312817 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312825 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312834 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312838 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312845 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312849 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312855 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312858 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312879 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312884 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312887 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312890 2556 flags.go:64] FLAG: --cgroup-root="" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312894 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312897 2556 flags.go:64] FLAG: --client-ca-file="" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312900 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312912 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312922 2556 flags.go:64] FLAG: --cluster-domain="" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312925 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 07:50:07.453666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312931 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312935 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312940 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312944 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312947 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312953 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312956 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312959 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312964 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312967 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312970 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312973 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312980 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312982 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312985 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312990 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312993 2556 flags.go:64] FLAG: --enable-server="true" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.312996 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313008 2556 flags.go:64] FLAG: --event-burst="100" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313013 2556 flags.go:64] FLAG: --event-qps="50" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313016 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313019 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313025 2556 flags.go:64] FLAG: --eviction-hard="" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313029 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 07:50:07.454648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313032 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313037 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313040 2556 flags.go:64] FLAG: --eviction-soft="" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313042 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313048 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313051 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313061 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313065 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313070 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313074 2556 flags.go:64] FLAG: --feature-gates="" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313080 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313083 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313086 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313089 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313092 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313095 2556 flags.go:64] FLAG: --help="false" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313098 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-128-86.ec2.internal" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313102 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313105 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313108 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313113 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313117 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313120 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 07:50:07.455384 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313125 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313128 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313131 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313134 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313139 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313142 2556 flags.go:64] FLAG: --kube-reserved="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313145 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313150 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313153 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313156 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313159 2556 flags.go:64] FLAG: --lock-file="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313163 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313166 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313169 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313176 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313179 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313190 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313193 2556 flags.go:64] FLAG: --logging-format="text" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313199 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313203 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313208 2556 flags.go:64] FLAG: --manifest-url="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313211 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313215 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313220 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313224 2556 flags.go:64] FLAG: --max-pods="110" Jul 14 07:50:07.456230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313228 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313233 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313235 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313238 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313243 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313246 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313249 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313259 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313262 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313267 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313270 2556 flags.go:64] FLAG: --pod-cidr="" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313273 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313280 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313283 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313288 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313290 2556 flags.go:64] FLAG: --port="10250" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313294 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313296 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0daf5237a5dca80a7" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313300 2556 flags.go:64] FLAG: --qos-reserved="" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313302 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313306 2556 flags.go:64] FLAG: --register-node="true" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313310 2556 flags.go:64] FLAG: --register-with-taints="" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313314 2556 flags.go:64] FLAG: --registry-burst="10" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313317 2556 flags.go:64] FLAG: --registry-qps="5" Jul 14 07:50:07.457084 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313323 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313326 2556 flags.go:64] FLAG: --reserved-memory="" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313333 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313336 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313339 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313342 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313347 2556 flags.go:64] FLAG: --runonce="false" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313350 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313353 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313358 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313360 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313363 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313366 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313371 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313374 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313377 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313382 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313384 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313387 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313392 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313395 2556 flags.go:64] FLAG: --system-cgroups="" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313398 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313406 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313409 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313412 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 07:50:07.638760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313418 2556 flags.go:64] FLAG: --tls-min-version="" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313421 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313428 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313431 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313434 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313439 2556 flags.go:64] FLAG: --v="2" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313443 2556 flags.go:64] FLAG: --version="false" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313446 2556 flags.go:64] FLAG: --vmodule="" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313455 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.313462 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313638 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313646 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313649 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313652 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313655 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313659 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313662 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313665 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313670 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313672 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313675 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313677 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.655249 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313682 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313684 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313687 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313689 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313694 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313697 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313700 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313704 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313707 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313709 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313711 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313714 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313718 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313721 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313726 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313730 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313732 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313737 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313739 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313744 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.657934 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313749 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313752 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313755 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313757 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313762 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313764 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313767 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313769 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313774 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313776 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313779 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313781 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313786 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313788 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313791 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313794 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313798 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313815 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313818 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313823 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.658527 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313826 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313828 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313833 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313835 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313839 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313844 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313846 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313849 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313852 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313856 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313859 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313863 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313868 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313871 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313874 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313876 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313881 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313884 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313886 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.659291 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313891 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313894 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313896 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313899 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313903 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313906 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313908 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313912 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313915 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313917 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313921 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313925 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313927 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313930 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313935 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313937 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313940 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313950 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313954 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.659966 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313959 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313962 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313965 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313970 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313973 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313977 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313982 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313985 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.313988 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.314577 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.325818 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.325836 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.325855 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.325865 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325919 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.660653 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325924 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325928 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325931 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325934 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325937 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325940 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325945 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325949 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325952 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325955 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325958 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325961 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325964 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325967 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325970 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325973 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325976 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325979 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325982 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325984 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.661151 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325987 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325990 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325994 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.325998 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326001 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326003 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326006 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326010 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326013 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326016 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326019 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326022 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326024 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326027 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326029 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326032 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326034 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326037 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326041 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.662032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326044 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326047 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326051 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326054 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326056 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326060 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326063 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326065 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326068 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326070 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326073 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326076 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326079 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326082 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326084 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326087 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326090 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326092 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326095 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326097 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.662581 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326101 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326103 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326111 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326114 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326116 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326119 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326122 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326125 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326127 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326130 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326132 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326135 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326137 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326140 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326143 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326146 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326148 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326151 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326153 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.663457 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326156 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326158 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326161 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326163 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326166 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326169 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326171 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326174 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326176 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326179 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326181 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326184 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326187 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326189 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326192 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326195 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326198 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326201 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326203 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.664020 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326206 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.326211 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326337 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326342 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326345 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326348 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326351 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326353 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326356 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326359 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326362 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326364 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326367 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326369 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326372 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 07:50:07.664561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326375 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326378 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326381 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326384 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326386 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326389 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326391 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326394 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326396 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326399 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326402 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326404 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326407 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326409 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326412 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326416 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326418 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326421 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326424 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326426 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 07:50:07.832032 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326429 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326432 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326434 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326437 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326439 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326442 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326444 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326447 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326450 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326452 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326455 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326458 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326460 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326463 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326465 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326468 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326470 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326473 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326476 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326478 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 07:50:07.832775 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326481 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326483 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326486 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326488 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326491 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326493 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326498 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326502 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326505 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326508 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326511 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326513 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326516 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326519 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326522 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326525 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326527 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326530 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326533 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 07:50:07.833496 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326535 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326538 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326540 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326543 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326546 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326549 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326551 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326554 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326556 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326560 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326563 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326566 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326569 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326572 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326575 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326577 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326580 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326583 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326585 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 07:50:07.834172 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326588 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326591 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326595 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326601 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326605 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326608 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326610 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:07.326613 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.326617 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.326723 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.328748 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.330171 2556 server.go:1019] "Starting client certificate rotation" Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.330269 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 07:50:07.834729 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.330306 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.332428 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.338525 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.351707 2556 log.go:25] "Validated CRI v1 runtime API" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.354226 2556 log.go:25] "Validated CRI v1 image API" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.354947 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.358675 2556 fs.go:135] Filesystem UUIDs: map[3bc7cfba-d690-4629-8293-bbb93cedead8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e9b5e0b3-c9b2-4cfa-be9b-f97dd4e698cb:/dev/nvme0n1p3] Jul 14 07:50:07.835319 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.358692 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.363779 2556 manager.go:216] Machine: {Timestamp:2026-07-14 07:50:07.36244381 +0000 UTC m=+0.390589329 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118647 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e3d760a33e41c5ba9f645a1b35ac SystemUUID:ec20e3d7-60a3-3e41-c5ba-9f645a1b35ac BootID:cd0a9103-d483-4ef6-bbff-5c04b21885c1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:cf:df:ca:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:cf:df:ca:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:cd:8f:e8:51:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.363898 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.363976 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.365534 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.371774 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.371816 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.373191 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.373202 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.373209 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.374086 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.375020 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.377969 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378091 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378118 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378128 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378145 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 07:50:08.003099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378155 2556 kubelet.go:398] "Adding apiserver pod source" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378164 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378513 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.378527 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.381342 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383102 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383140 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383761 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383777 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383786 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383794 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383822 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383830 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383926 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383934 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383943 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383952 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383964 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.383975 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.386974 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmh98" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.387373 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.387384 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.389306 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.389983 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.389984 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.390592 2556 server.go:1268] "Started kubelet" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.390674 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.391200 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.391270 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.392558 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.396035 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.396770 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.398385 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmh98" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.398126 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-86.ec2.internal.18c2188f9756a6c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-86.ec2.internal,UID:ip-10-0-128-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-86.ec2.internal,},FirstTimestamp:2026-07-14 07:50:07.390566087 +0000 UTC m=+0.418711604,LastTimestamp:2026-07-14 07:50:07.390566087 +0000 UTC m=+0.418711604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-86.ec2.internal,}" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.407737 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.407747 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.407818 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408351 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408474 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408489 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 07:50:08.003708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408573 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408583 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408650 2556 factory.go:55] Registering systemd factory Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408667 2556 factory.go:223] Registration of the systemd container factory successfully Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408906 2556 factory.go:153] Registering CRI-O factory Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408918 2556 factory.go:223] Registration of the crio container factory successfully Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408966 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.408990 2556 factory.go:103] Registering Raw factory Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.409005 2556 manager.go:1196] Started watching for new ooms in manager Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.410219 2556 manager.go:349] Starting recovery of all containers Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.417403 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.420784 2556 manager.go:354] Recovery completed Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.421279 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-86.ec2.internal\" not found" node="ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.425858 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.428304 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.428337 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.428350 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.429177 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.429371 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.429571 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.429694 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.430344 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.430368 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.430382 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.432029 2556 policy_none.go:49] "None policy: Start" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.432043 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.432053 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.433138 2556 policy_none.go:47] "Start" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475360 2556 manager.go:337] "Starting Device Plugin manager" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.475388 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475398 2556 server.go:87] "Starting device plugin registration server" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475652 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475666 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475846 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475925 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.475932 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.476496 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.476535 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.576317 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.577482 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.577511 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.577525 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.577557 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.585420 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.586984 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.587026 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.587053 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.587100 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.589307 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.589330 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-86.ec2.internal\": node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.009451 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.589643 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.611535 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.690787 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal"] Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.690885 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.692948 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.692985 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.692996 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.694574 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.694689 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.694741 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695415 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695420 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695438 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695449 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695439 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.695538 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.696527 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.696550 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.697235 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientMemory" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.697264 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.697278 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeHasSufficientPID" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.709811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.709838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08b1320a39f521a3cd69b9201d40291d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-86.ec2.internal\" (UID: \"08b1320a39f521a3cd69b9201d40291d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.709856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.711897 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.730503 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-86.ec2.internal\" not found" node="ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.734790 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-86.ec2.internal\" not found" node="ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.011336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08b1320a39f521a3cd69b9201d40291d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-86.ec2.internal\" (UID: \"08b1320a39f521a3cd69b9201d40291d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.012217 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810324 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08b1320a39f521a3cd69b9201d40291d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-86.ec2.internal\" (UID: \"08b1320a39f521a3cd69b9201d40291d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.012217 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.012217 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:07.810356 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49b1e10a5b41f773499f1e53a2ef8bb8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal\" (UID: \"49b1e10a5b41f773499f1e53a2ef8bb8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.012217 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.812318 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.012217 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:07.913156 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.014559 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.013706 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.032921 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.032895 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.037053 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.037015 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.113937 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.113903 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.214465 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.214437 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.314981 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.314909 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.330091 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.330065 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 07:50:08.330229 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.330206 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 07:50:08.330280 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.330210 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 07:50:08.406689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.406651 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 07:45:07 +0000 UTC" deadline="2027-12-10 07:48:48.395334835 +0000 UTC" Jul 14 07:50:08.406689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.406680 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12335h58m39.988657477s" Jul 14 07:50:08.416026 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.415997 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.516286 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:08.516255 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-86.ec2.internal\" not found" Jul 14 07:50:08.525942 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.525921 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:08.553606 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:08.553564 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b1320a39f521a3cd69b9201d40291d.slice/crio-3844a134531cd55cb2acefa45009473758aa33da53696c6cb78c20c088b0fc2c WatchSource:0}: Error finding container 3844a134531cd55cb2acefa45009473758aa33da53696c6cb78c20c088b0fc2c: Status 404 returned error can't find the container with id 3844a134531cd55cb2acefa45009473758aa33da53696c6cb78c20c088b0fc2c Jul 14 07:50:08.556399 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:08.556372 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b1e10a5b41f773499f1e53a2ef8bb8.slice/crio-89c8b71cbe714eed74a6f1930ecd924b93a96f81663ae07da7c1814ccb3cc712 WatchSource:0}: Error finding container 89c8b71cbe714eed74a6f1930ecd924b93a96f81663ae07da7c1814ccb3cc712: Status 404 returned error can't find the container with id 89c8b71cbe714eed74a6f1930ecd924b93a96f81663ae07da7c1814ccb3cc712 Jul 14 07:50:08.559215 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.559197 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 07:50:08.590928 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.590792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" event={"ID":"49b1e10a5b41f773499f1e53a2ef8bb8","Type":"ContainerStarted","Data":"89c8b71cbe714eed74a6f1930ecd924b93a96f81663ae07da7c1814ccb3cc712"} Jul 14 07:50:08.591758 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.591737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" event={"ID":"08b1320a39f521a3cd69b9201d40291d","Type":"ContainerStarted","Data":"3844a134531cd55cb2acefa45009473758aa33da53696c6cb78c20c088b0fc2c"} Jul 14 07:50:08.608922 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.608894 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.619662 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.619642 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 07:50:08.621890 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.621877 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" Jul 14 07:50:08.632310 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.632297 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 07:50:08.819104 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:08.819073 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:09.347608 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.347584 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:09.366985 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.366957 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 07:50:09.378969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.378942 2556 apiserver.go:52] "Watching apiserver" Jul 14 07:50:09.385530 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.385503 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 07:50:09.386010 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.385979 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-f2s9t","openshift-multus/network-metrics-daemon-5bk54","openshift-network-diagnostics/network-check-target-z56lr","kube-system/global-pull-secret-syncer-j45vv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk","openshift-image-registry/node-ca-jwbql","openshift-multus/multus-dlkqf","openshift-network-operator/iptables-alerter-fkfm9","openshift-ovn-kubernetes/ovnkube-node-dshcq","kube-system/konnectivity-agent-zsg52","kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dzjm9","openshift-dns/node-resolver-644rv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal"] Jul 14 07:50:09.387653 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.387632 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.388716 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.388688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.389855 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.389836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:09.389955 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.389870 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 07:50:09.389955 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.389904 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:09.390179 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.390023 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.390356 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.390268 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.390356 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.390308 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 07:50:09.390538 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.390363 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-plbxq\"" Jul 14 07:50:09.391390 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.391164 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.391488 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.391254 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:09.391488 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.391468 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.391861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.391841 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-55zrk\"" Jul 14 07:50:09.392214 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.392193 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.393918 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.393641 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.395396 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.394656 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.396392 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.396359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 07:50:09.396611 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.396511 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.396841 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.396724 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x7jfs\"" Jul 14 07:50:09.397149 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.396977 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.397471 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.397392 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 07:50:09.397471 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.397451 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.397728 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.397686 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.398328 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.398310 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.398488 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.398437 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8554\"" Jul 14 07:50:09.399309 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.399283 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.399916 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.399897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 07:50:09.400624 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.400436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.400624 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.400508 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:09.400624 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.400611 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 07:50:09.400624 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.400623 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwqd5\"" Jul 14 07:50:09.400872 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.400692 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.401245 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401064 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 07:50:09.401245 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401066 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 07:50:09.401245 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401070 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.401442 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401426 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 07:50:09.401727 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401657 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 07:50:09.401727 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401692 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hz5rs\"" Jul 14 07:50:09.401892 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.401768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.403557 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.403539 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.403745 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.403728 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 07:50:09.404063 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.404044 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9b8h2\"" Jul 14 07:50:09.404142 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.404127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 07:50:09.405312 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.405293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.408768 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.408571 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8q749\"" Jul 14 07:50:09.408768 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.408764 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.408952 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.408933 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 07:50:09.409049 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.408965 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.409111 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.409064 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 07:50:09.409218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.409202 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7bkq\"" Jul 14 07:50:09.409433 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.409415 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 07:50:09.409619 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.409441 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 07:50:09.409700 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.409686 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 07:50:09.419738 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-os-release\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.419877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cni-binary-copy\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.419877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deca4ba6-7565-449f-9171-c52a407eae31-iptables-alerter-script\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.419877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cnibin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.419877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-etc-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-tuned\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.419948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-netns\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-systemd-units\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-ovn\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420088 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cnibin\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-sys\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovn-node-metrics-cert\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420158 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-script-lib\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1e40d2-5011-43b3-8f3d-b557cfb99430-tmp-dir\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-k8s-cni-cncf-io\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-hostroot\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-conf-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.420361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-slash\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-registration-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbm29\" (UniqueName: \"kubernetes.io/projected/298aaa8a-ffe3-481d-8562-0547fcb19a77-kube-api-access-wbm29\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs27p\" (UniqueName: \"kubernetes.io/projected/7442787c-78a0-4115-9881-25a4a8c86d6d-kube-api-access-qs27p\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-run\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-lib-modules\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-etc-kubernetes\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-node-log\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-config\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.420843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd26k\" (UniqueName: \"kubernetes.io/projected/deca4ba6-7565-449f-9171-c52a407eae31-kube-api-access-qd26k\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-socket-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce475909-65d7-4853-8c25-107065c477ac-host\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-kubelet\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.420967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-bin\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce475909-65d7-4853-8c25-107065c477ac-serviceca\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k88xx\" (UniqueName: \"kubernetes.io/projected/ce475909-65d7-4853-8c25-107065c477ac-kube-api-access-k88xx\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-dbus\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-log-socket\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421115 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6g5\" (UniqueName: \"kubernetes.io/projected/11414ead-fbbb-4bc5-a468-89af7dcc5f03-kube-api-access-sn6g5\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421262 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-sys-fs\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.421398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-host\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-netd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421360 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-os-release\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deca4ba6-7565-449f-9171-c52a407eae31-host-slash\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421440 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-multus-certs\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56k5n\" (UniqueName: \"kubernetes.io/projected/7e1e40d2-5011-43b3-8f3d-b557cfb99430-kube-api-access-56k5n\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-kubelet\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-socket-dir-parent\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysconfig\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-multus\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-daemon-config\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-netns\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-systemd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.422097 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-env-overrides\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-device-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.421993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-konnectivity-ca\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-var-lib-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-etc-selinux\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-kubernetes\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422097 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-bin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-kubelet-config\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cws5\" (UniqueName: \"kubernetes.io/projected/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-kube-api-access-9cws5\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-agent-certs\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-modprobe-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-systemd\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422361 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hp9\" (UniqueName: \"kubernetes.io/projected/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-kube-api-access-v2hp9\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-system-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e1e40d2-5011-43b3-8f3d-b557cfb99430-hosts-file\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9kg\" (UniqueName: \"kubernetes.io/projected/dda8640c-cfe2-48a6-9b0b-76703beaebc9-kube-api-access-bw9kg\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.423102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-conf\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423927 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-var-lib-kubelet\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.423927 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.422499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-tmp\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.425014 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.424992 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 07:50:09.486468 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.486414 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-22cx4" Jul 14 07:50:09.494195 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.494169 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-22cx4" Jul 14 07:50:09.523083 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-socket-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce475909-65d7-4853-8c25-107065c477ac-host\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-kubelet\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523167 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-kubelet\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523169 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523167 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce475909-65d7-4853-8c25-107065c477ac-host\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.523233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-bin\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-socket-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523256 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-bin\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce475909-65d7-4853-8c25-107065c477ac-serviceca\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k88xx\" (UniqueName: \"kubernetes.io/projected/ce475909-65d7-4853-8c25-107065c477ac-kube-api-access-k88xx\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-dbus\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-log-socket\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523511 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523475 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-log-socket\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-dbus\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6g5\" (UniqueName: \"kubernetes.io/projected/11414ead-fbbb-4bc5-a468-89af7dcc5f03-kube-api-access-sn6g5\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-sys-fs\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-host\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-netd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-os-release\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deca4ba6-7565-449f-9171-c52a407eae31-host-slash\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523819 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce475909-65d7-4853-8c25-107065c477ac-serviceca\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-multus-certs\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523844 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.523943 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523879 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deca4ba6-7565-449f-9171-c52a407eae31-host-slash\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-cni-netd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56k5n\" (UniqueName: \"kubernetes.io/projected/7e1e40d2-5011-43b3-8f3d-b557cfb99430-kube-api-access-56k5n\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523913 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-kubelet\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-os-release\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-socket-dir-parent\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523954 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-host\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysconfig\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-sys-fs\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-multus-certs\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.523999 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-socket-dir-parent\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-multus\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524028 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-kubelet\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524046 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-system-cni-dir\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524049 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.524723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524059 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-multus\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysconfig\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524086 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-daemon-config\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-netns\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-systemd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-env-overrides\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-run-netns\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-device-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-konnectivity-ca\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-var-lib-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524282 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-etc-selinux\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524294 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-device-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524169 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-systemd\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-kubernetes\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-bin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524354 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-var-lib-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.525528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-kubelet-config\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cws5\" (UniqueName: \"kubernetes.io/projected/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-kube-api-access-9cws5\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-kubernetes\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-agent-certs\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-modprobe-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-systemd\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hp9\" (UniqueName: \"kubernetes.io/projected/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-kube-api-access-v2hp9\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-etc-selinux\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-system-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e1e40d2-5011-43b3-8f3d-b557cfb99430-hosts-file\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9kg\" (UniqueName: \"kubernetes.io/projected/dda8640c-cfe2-48a6-9b0b-76703beaebc9-kube-api-access-bw9kg\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524595 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-env-overrides\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-conf\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-var-lib-kubelet\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524636 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-daemon-config\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-tmp\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-os-release\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0de23af4-ddf6-481f-897b-9cb274054915-kubelet-config\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.526274 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cni-binary-copy\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deca4ba6-7565-449f-9171-c52a407eae31-iptables-alerter-script\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-modprobe-d\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524783 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-var-lib-cni-bin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cnibin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-system-cni-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-konnectivity-ca\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-etc-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cnibin\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-var-lib-kubelet\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524841 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-os-release\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524956 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e1e40d2-5011-43b3-8f3d-b557cfb99430-hosts-file\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524964 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-sysctl-conf\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-systemd\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.524988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-tuned\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-netns\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.525086 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:09.527188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-systemd-units\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-ovn\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cnibin\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.525179 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.025136919 +0000 UTC m=+3.053282442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525185 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cnibin\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525015 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-etc-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-sys\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovn-node-metrics-cert\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-script-lib\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525278 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-systemd-units\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525318 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1e40d2-5011-43b3-8f3d-b557cfb99430-tmp-dir\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525247 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-netns\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525336 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11414ead-fbbb-4bc5-a468-89af7dcc5f03-cni-binary-copy\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-k8s-cni-cncf-io\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-hostroot\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528100 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-conf-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-slash\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525489 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deca4ba6-7565-449f-9171-c52a407eae31-iptables-alerter-script\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525506 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-sys\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-registration-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525532 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298aaa8a-ffe3-481d-8562-0547fcb19a77-registration-dir\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbm29\" (UniqueName: \"kubernetes.io/projected/298aaa8a-ffe3-481d-8562-0547fcb19a77-kube-api-access-wbm29\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs27p\" (UniqueName: \"kubernetes.io/projected/7442787c-78a0-4115-9881-25a4a8c86d6d-kube-api-access-qs27p\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525602 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-host-run-k8s-cni-cncf-io\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-run\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-lib-modules\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525637 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-run\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-etc-kubernetes\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-node-log\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-config\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:09.528710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-script-lib\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd26k\" (UniqueName: \"kubernetes.io/projected/deca4ba6-7565-449f-9171-c52a407eae31-kube-api-access-qd26k\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-ovn\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.525993 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-hostroot\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526037 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-multus-conf-dir\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526076 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-host-slash\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.526086 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-run-openvswitch\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.526140 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.026125438 +0000 UTC m=+3.054270961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526181 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-node-log\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526203 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-lib-modules\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526212 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1e40d2-5011-43b3-8f3d-b557cfb99430-tmp-dir\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11414ead-fbbb-4bc5-a468-89af7dcc5f03-etc-kubernetes\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526255 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-cni-binary-copy\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526706 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovnkube-config\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.526730 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dda8640c-cfe2-48a6-9b0b-76703beaebc9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.529277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.528419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-etc-tuned\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.529933 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.528490 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-ovn-node-metrics-cert\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.529933 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.528589 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53ba54c9-daa2-4913-96c0-4a101a4f4cc7-agent-certs\") pod \"konnectivity-agent-zsg52\" (UID: \"53ba54c9-daa2-4913-96c0-4a101a4f4cc7\") " pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.529933 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.528613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-tmp\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.531767 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.531741 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k88xx\" (UniqueName: \"kubernetes.io/projected/ce475909-65d7-4853-8c25-107065c477ac-kube-api-access-k88xx\") pod \"node-ca-jwbql\" (UID: \"ce475909-65d7-4853-8c25-107065c477ac\") " pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.532392 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.532372 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56k5n\" (UniqueName: \"kubernetes.io/projected/7e1e40d2-5011-43b3-8f3d-b557cfb99430-kube-api-access-56k5n\") pod \"node-resolver-644rv\" (UID: \"7e1e40d2-5011-43b3-8f3d-b557cfb99430\") " pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.532491 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.532426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hp9\" (UniqueName: \"kubernetes.io/projected/0ec97f7d-7923-48ff-a4ac-958ff9262ac9-kube-api-access-v2hp9\") pod \"tuned-dzjm9\" (UID: \"0ec97f7d-7923-48ff-a4ac-958ff9262ac9\") " pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:09.532599 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.532580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6g5\" (UniqueName: \"kubernetes.io/projected/11414ead-fbbb-4bc5-a468-89af7dcc5f03-kube-api-access-sn6g5\") pod \"multus-dlkqf\" (UID: \"11414ead-fbbb-4bc5-a468-89af7dcc5f03\") " pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.533410 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.533374 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9kg\" (UniqueName: \"kubernetes.io/projected/dda8640c-cfe2-48a6-9b0b-76703beaebc9-kube-api-access-bw9kg\") pod \"multus-additional-cni-plugins-f2s9t\" (UID: \"dda8640c-cfe2-48a6-9b0b-76703beaebc9\") " pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.535371 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.535352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cws5\" (UniqueName: \"kubernetes.io/projected/2c1600a2-277c-49b6-b8a6-f191bd32bb8a-kube-api-access-9cws5\") pod \"ovnkube-node-dshcq\" (UID: \"2c1600a2-277c-49b6-b8a6-f191bd32bb8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.538067 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.538038 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:09.538067 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.538059 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:09.538067 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.538073 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:09.538268 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:09.538127 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:10.038111086 +0000 UTC m=+3.066256594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:09.539300 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.539280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbm29\" (UniqueName: \"kubernetes.io/projected/298aaa8a-ffe3-481d-8562-0547fcb19a77-kube-api-access-wbm29\") pod \"aws-ebs-csi-driver-node-tppxk\" (UID: \"298aaa8a-ffe3-481d-8562-0547fcb19a77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.541117 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.541093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs27p\" (UniqueName: \"kubernetes.io/projected/7442787c-78a0-4115-9881-25a4a8c86d6d-kube-api-access-qs27p\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:09.541215 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.541126 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd26k\" (UniqueName: \"kubernetes.io/projected/deca4ba6-7565-449f-9171-c52a407eae31-kube-api-access-qd26k\") pod \"iptables-alerter-fkfm9\" (UID: \"deca4ba6-7565-449f-9171-c52a407eae31\") " pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.703096 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.703004 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dlkqf" Jul 14 07:50:09.710899 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.710862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-644rv" Jul 14 07:50:09.719655 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.719625 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" Jul 14 07:50:09.726192 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.726173 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jwbql" Jul 14 07:50:09.737899 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.737876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:09.747210 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.747187 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" Jul 14 07:50:09.754422 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.754392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:09.759358 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.759337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fkfm9" Jul 14 07:50:09.764442 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:09.764419 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" Jul 14 07:50:10.029838 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.029742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:10.029838 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.029787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:10.030039 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.029907 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:10.030039 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.029932 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:10.030039 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.029973 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:11.029956183 +0000 UTC m=+4.058101689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:10.030039 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.029989 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:11.029981974 +0000 UTC m=+4.058127480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:10.131002 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.130960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:10.131254 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.131157 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:10.131254 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.131179 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:10.131254 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.131189 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:10.131422 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:10.131260 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:11.131238531 +0000 UTC m=+4.159384036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:10.440505 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.440091 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1600a2_277c_49b6_b8a6_f191bd32bb8a.slice/crio-41ce1737c17001a959e28aa1c963b329dab1ebfd14ad78ac3227894238ae591b WatchSource:0}: Error finding container 41ce1737c17001a959e28aa1c963b329dab1ebfd14ad78ac3227894238ae591b: Status 404 returned error can't find the container with id 41ce1737c17001a959e28aa1c963b329dab1ebfd14ad78ac3227894238ae591b Jul 14 07:50:10.443400 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.443255 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298aaa8a_ffe3_481d_8562_0547fcb19a77.slice/crio-1c946a551f3c11a24656f77ebd28fb0d78fed4c008ffdf49e520550254898c01 WatchSource:0}: Error finding container 1c946a551f3c11a24656f77ebd28fb0d78fed4c008ffdf49e520550254898c01: Status 404 returned error can't find the container with id 1c946a551f3c11a24656f77ebd28fb0d78fed4c008ffdf49e520550254898c01 Jul 14 07:50:10.446537 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.446469 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec97f7d_7923_48ff_a4ac_958ff9262ac9.slice/crio-43a1c9504c4e3772b3f98d912b6c0cb180aca38ffeb9109f57a60c82823a9b11 WatchSource:0}: Error finding container 43a1c9504c4e3772b3f98d912b6c0cb180aca38ffeb9109f57a60c82823a9b11: Status 404 returned error can't find the container with id 43a1c9504c4e3772b3f98d912b6c0cb180aca38ffeb9109f57a60c82823a9b11 Jul 14 07:50:10.448124 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.447602 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ba54c9_daa2_4913_96c0_4a101a4f4cc7.slice/crio-afc18d40e513a6d2ffc413897bf885ccb2770bd69b86a6371decae30fe1dcf09 WatchSource:0}: Error finding container afc18d40e513a6d2ffc413897bf885ccb2770bd69b86a6371decae30fe1dcf09: Status 404 returned error can't find the container with id afc18d40e513a6d2ffc413897bf885ccb2770bd69b86a6371decae30fe1dcf09 Jul 14 07:50:10.448470 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.448387 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce475909_65d7_4853_8c25_107065c477ac.slice/crio-72330558f9c3b0eee869a28092b6cd6d2762eaab31be331e6db74bb4296f864d WatchSource:0}: Error finding container 72330558f9c3b0eee869a28092b6cd6d2762eaab31be331e6db74bb4296f864d: Status 404 returned error can't find the container with id 72330558f9c3b0eee869a28092b6cd6d2762eaab31be331e6db74bb4296f864d Jul 14 07:50:10.449561 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.449538 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeca4ba6_7565_449f_9171_c52a407eae31.slice/crio-c55535777da3f94de05707fd99a17b48099aa3bbfb9930f80cf72174e0712d5e WatchSource:0}: Error finding container c55535777da3f94de05707fd99a17b48099aa3bbfb9930f80cf72174e0712d5e: Status 404 returned error can't find the container with id c55535777da3f94de05707fd99a17b48099aa3bbfb9930f80cf72174e0712d5e Jul 14 07:50:10.459055 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:10.459035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda8640c_cfe2_48a6_9b0b_76703beaebc9.slice/crio-4038d789ddfe8c7f6255f24dd714cdb296768bdc5de1358774cb759935629a9d WatchSource:0}: Error finding container 4038d789ddfe8c7f6255f24dd714cdb296768bdc5de1358774cb759935629a9d: Status 404 returned error can't find the container with id 4038d789ddfe8c7f6255f24dd714cdb296768bdc5de1358774cb759935629a9d Jul 14 07:50:10.496888 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.496657 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:45:09 +0000 UTC" deadline="2027-12-28 00:52:42.887794547 +0000 UTC" Jul 14 07:50:10.497027 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.496890 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12761h2m32.390911533s" Jul 14 07:50:10.596203 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.596170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerStarted","Data":"4038d789ddfe8c7f6255f24dd714cdb296768bdc5de1358774cb759935629a9d"} Jul 14 07:50:10.597431 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.597407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" event={"ID":"0ec97f7d-7923-48ff-a4ac-958ff9262ac9","Type":"ContainerStarted","Data":"43a1c9504c4e3772b3f98d912b6c0cb180aca38ffeb9109f57a60c82823a9b11"} Jul 14 07:50:10.598548 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.598521 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsg52" event={"ID":"53ba54c9-daa2-4913-96c0-4a101a4f4cc7","Type":"ContainerStarted","Data":"afc18d40e513a6d2ffc413897bf885ccb2770bd69b86a6371decae30fe1dcf09"} Jul 14 07:50:10.599652 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.599627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwbql" event={"ID":"ce475909-65d7-4853-8c25-107065c477ac","Type":"ContainerStarted","Data":"72330558f9c3b0eee869a28092b6cd6d2762eaab31be331e6db74bb4296f864d"} Jul 14 07:50:10.603479 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.603450 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" event={"ID":"298aaa8a-ffe3-481d-8562-0547fcb19a77","Type":"ContainerStarted","Data":"1c946a551f3c11a24656f77ebd28fb0d78fed4c008ffdf49e520550254898c01"} Jul 14 07:50:10.605518 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.605498 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" event={"ID":"08b1320a39f521a3cd69b9201d40291d","Type":"ContainerStarted","Data":"8f7d79f63d962ece341994537d545a0ac717e30520a68440128c3bef02ba8fec"} Jul 14 07:50:10.606620 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.606599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-644rv" event={"ID":"7e1e40d2-5011-43b3-8f3d-b557cfb99430","Type":"ContainerStarted","Data":"89b7808801a4db5f9366fa9730886695e728d594849ac8607a55481ad66d79e3"} Jul 14 07:50:10.607703 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.607682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dlkqf" event={"ID":"11414ead-fbbb-4bc5-a468-89af7dcc5f03","Type":"ContainerStarted","Data":"000eb3cd48bc5288fe3a6c6c992e8df957d8a9f047a871ac0960fdd9d0d0f3c3"} Jul 14 07:50:10.608791 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.608772 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkfm9" event={"ID":"deca4ba6-7565-449f-9171-c52a407eae31","Type":"ContainerStarted","Data":"c55535777da3f94de05707fd99a17b48099aa3bbfb9930f80cf72174e0712d5e"} Jul 14 07:50:10.609925 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.609907 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"41ce1737c17001a959e28aa1c963b329dab1ebfd14ad78ac3227894238ae591b"} Jul 14 07:50:10.619761 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:10.619719 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-86.ec2.internal" podStartSLOduration=2.619698782 podStartE2EDuration="2.619698782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:10.619166425 +0000 UTC m=+3.647311954" watchObservedRunningTime="2026-07-14 07:50:10.619698782 +0000 UTC m=+3.647844309" Jul 14 07:50:11.038109 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.037968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:11.038109 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.038026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:11.038325 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.038177 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:11.038325 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.038240 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.038220708 +0000 UTC m=+6.066366216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:11.038645 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.038630 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:11.038738 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.038682 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.038665607 +0000 UTC m=+6.066811114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:11.138923 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.138883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:11.139104 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.139067 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:11.139104 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.139089 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:11.139104 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.139103 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:11.139329 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.139161 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:13.139143392 +0000 UTC m=+6.167288920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:11.498147 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.498077 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 07:45:09 +0000 UTC" deadline="2027-12-13 00:44:08.650987791 +0000 UTC" Jul 14 07:50:11.498147 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.498146 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12400h53m57.15284653s" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.587327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.587459 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.587870 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.587964 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.588033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:11.588152 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:11.588112 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:11.624220 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.624179 2556 generic.go:356] "Generic (PLEG): container finished" podID="49b1e10a5b41f773499f1e53a2ef8bb8" containerID="ef49c9da4f7d13ed9696ccd7937b19daad5eb4748384ad035a0bc2fed7b1dc50" exitCode=0 Jul 14 07:50:11.624404 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:11.624264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" event={"ID":"49b1e10a5b41f773499f1e53a2ef8bb8","Type":"ContainerDied","Data":"ef49c9da4f7d13ed9696ccd7937b19daad5eb4748384ad035a0bc2fed7b1dc50"} Jul 14 07:50:12.648614 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:12.647976 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" event={"ID":"49b1e10a5b41f773499f1e53a2ef8bb8","Type":"ContainerStarted","Data":"db8993dbd3e52529db4a1b718b4fdae0c89bcd693e83e5f95a71ecfdc9f22f03"} Jul 14 07:50:13.059010 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.058919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:13.059198 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.059037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:13.059198 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.059188 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:13.059312 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.059253 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.059232721 +0000 UTC m=+10.087378239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:13.059696 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.059676 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:13.059790 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.059733 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.05971717 +0000 UTC m=+10.087862689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:13.160072 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.160032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:13.160259 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.160200 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:13.160259 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.160219 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:13.160259 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.160231 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:13.160405 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.160290 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:17.160271789 +0000 UTC m=+10.188417313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:13.587872 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.587791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:13.588149 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.587819 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:13.588149 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.587953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:13.588149 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.588008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:13.588149 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:13.587828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:13.588149 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:13.588116 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:15.588107 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:15.588028 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:15.588540 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:15.588166 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:15.588598 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:15.588566 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:15.588700 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:15.588678 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:15.588783 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:15.588761 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:15.588935 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:15.588909 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:17.097363 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.096894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:17.097848 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.097500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:17.098769 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.098245 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:17.098769 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.098351 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:25.098327346 +0000 UTC m=+18.126472858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:17.102031 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.099100 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:17.102031 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.099172 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:25.099145977 +0000 UTC m=+18.127291501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:17.198506 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.198458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:17.198688 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.198619 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:17.198688 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.198640 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:17.198688 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.198653 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:17.198868 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.198713 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:25.198694026 +0000 UTC m=+18.226839535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:17.589129 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.588786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:17.589129 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.588940 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:17.589129 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.588965 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:17.589129 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.589032 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:17.589129 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:17.589058 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:17.589500 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:17.589172 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:19.588148 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:19.588070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:19.588586 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:19.588214 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:19.588586 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:19.588235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:19.588586 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:19.588333 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:19.588586 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:19.588365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:19.588586 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:19.588417 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:21.587736 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:21.587699 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:21.588218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:21.587710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:21.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:21.587842 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:21.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:21.587982 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:21.588218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:21.588021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:21.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:21.588093 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:23.587426 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:23.587389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:23.587842 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:23.587389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:23.587842 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:23.587529 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:23.587842 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:23.587614 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:23.587842 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:23.587396 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:23.587842 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:23.587716 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:25.163685 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.163648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:25.163685 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.163691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:25.164210 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.163825 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:25.164210 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.163888 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:41.163873055 +0000 UTC m=+34.192018560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:25.164210 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.163828 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:25.164210 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.163974 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:50:41.163958594 +0000 UTC m=+34.192104098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:25.264572 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.264536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:25.265177 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.264954 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:25.265177 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.265001 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:25.265177 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.265016 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:25.265177 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.265083 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:50:41.265063839 +0000 UTC m=+34.293209345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:25.588422 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.588322 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:25.588422 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.588321 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:25.588629 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:25.588467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:25.588629 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.588459 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:25.588629 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.588584 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:25.588779 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:25.588672 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:27.588578 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:27.588537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:27.589055 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:27.588646 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:27.589055 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:27.588694 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:27.589055 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:27.588751 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:27.589055 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:27.588827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:27.589055 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:27.588972 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:29.588687 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.588264 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:29.589432 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.588276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:29.589432 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:29.588743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:29.589432 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.588332 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:29.589432 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:29.588880 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:29.589432 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:29.588966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:29.682630 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.682597 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="563df6b31b1e3fb12f053c3d845e37a5680fca5ba735da1dd327b6867e3dd8fd" exitCode=0 Jul 14 07:50:29.682816 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.682669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"563df6b31b1e3fb12f053c3d845e37a5680fca5ba735da1dd327b6867e3dd8fd"} Jul 14 07:50:29.684300 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.684276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" event={"ID":"0ec97f7d-7923-48ff-a4ac-958ff9262ac9","Type":"ContainerStarted","Data":"fd76d11432ec6b1f03825b7dbc87bbad24ecb4af964c3bfd106f2d846c315ec7"} Jul 14 07:50:29.685617 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.685593 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zsg52" event={"ID":"53ba54c9-daa2-4913-96c0-4a101a4f4cc7","Type":"ContainerStarted","Data":"031454250caed1004b856a59f49b67c1ca537f0b0e764c6045ec00517a1615ed"} Jul 14 07:50:29.686887 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.686868 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jwbql" event={"ID":"ce475909-65d7-4853-8c25-107065c477ac","Type":"ContainerStarted","Data":"a0f3281b6f14eb411a827894f8b691863228d276accedd1fad93a89b40d42b57"} Jul 14 07:50:29.688248 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.688227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" event={"ID":"298aaa8a-ffe3-481d-8562-0547fcb19a77","Type":"ContainerStarted","Data":"44deb19e475b011f0360e9b3bf3fd87536266f28b77f2d5638dfd26ebd25eafe"} Jul 14 07:50:29.689576 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.689551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-644rv" event={"ID":"7e1e40d2-5011-43b3-8f3d-b557cfb99430","Type":"ContainerStarted","Data":"6b88536c7d7a06e41756c9a31c183b111d379d16de8a4d7356d588d80f088987"} Jul 14 07:50:29.690978 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.690961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dlkqf" event={"ID":"11414ead-fbbb-4bc5-a468-89af7dcc5f03","Type":"ContainerStarted","Data":"a724ecd363fd65a7991dc418f2f71820169eaf0802451f346067d273bbc703b2"} Jul 14 07:50:29.693553 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"2d42a79993407b7d65419e6e42310fdefc29331a25f6483f94572a6096680654"} Jul 14 07:50:29.693626 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"f374c3e75dd67291c5a98378cf0eff24fa9347a42ca0f170f6bd0ad1581f1034"} Jul 14 07:50:29.693626 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"af5760e02c7676539a57b5e85bea165baa5db7ab1e4f529868f848c44f89a78b"} Jul 14 07:50:29.693689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693643 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"dddac5259abe9c1ff4c74ca130c8d62cc345b0a0054ccf073411fb482d47b95d"} Jul 14 07:50:29.693689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"c4c0740c5d7534af9d0ce0fc36f68c19e8b12992e8b7594b4b880a88e3cf76fb"} Jul 14 07:50:29.693750 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.693695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"2dc1d092df6420294d70bbcd279bc4fa84747f6731b94b6bc580dcfc1de94bfe"} Jul 14 07:50:29.708450 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.708413 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-86.ec2.internal" podStartSLOduration=21.708402397 podStartE2EDuration="21.708402397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:12.663781478 +0000 UTC m=+5.691927006" watchObservedRunningTime="2026-07-14 07:50:29.708402397 +0000 UTC m=+22.736547924" Jul 14 07:50:29.724080 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.724039 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jwbql" podStartSLOduration=4.480170691 podStartE2EDuration="22.724027881s" totalImagesPullingTime="18.24385719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.72386546 +0000 UTC m=+22.752010988" watchObservedRunningTime="2026-07-14 07:50:29.724027881 +0000 UTC m=+22.752173408" Jul 14 07:50:29.767013 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.766954 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-644rv" podStartSLOduration=4.526894127 podStartE2EDuration="22.766939296s" totalImagesPullingTime="18.240045169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.744585221 +0000 UTC m=+22.772730796" watchObservedRunningTime="2026-07-14 07:50:29.766939296 +0000 UTC m=+22.795084853" Jul 14 07:50:29.785432 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.785386 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zsg52" podStartSLOduration=8.820022981 podStartE2EDuration="22.785367779s" totalImagesPullingTime="13.965344798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.76690406 +0000 UTC m=+22.795049586" watchObservedRunningTime="2026-07-14 07:50:29.785367779 +0000 UTC m=+22.813513300" Jul 14 07:50:29.804540 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.804497 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dlkqf" podStartSLOduration=4.5025209440000005 podStartE2EDuration="22.804484113s" totalImagesPullingTime="18.301963169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.804422574 +0000 UTC m=+22.832568100" watchObservedRunningTime="2026-07-14 07:50:29.804484113 +0000 UTC m=+22.832629640" Jul 14 07:50:29.804780 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.804761 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dzjm9" podStartSLOduration=4.557003251 podStartE2EDuration="22.804756186s" totalImagesPullingTime="18.247752935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:29.78553978 +0000 UTC m=+22.813685307" watchObservedRunningTime="2026-07-14 07:50:29.804756186 +0000 UTC m=+22.832901713" Jul 14 07:50:29.993446 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:29.993422 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 07:50:30.488816 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.488687 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T07:50:29.993440457Z","UUID":"7a03dc0d-05de-457a-9dcc-8deb96adf968","Handler":null,"Name":"","Endpoint":""} Jul 14 07:50:30.490381 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.490353 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 07:50:30.490514 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.490395 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 07:50:30.607409 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.607369 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:30.608070 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.608040 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:30.698478 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.698444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" event={"ID":"298aaa8a-ffe3-481d-8562-0547fcb19a77","Type":"ContainerStarted","Data":"8caf823ea442cf0cc7bf98530ff7b5f03ddf370ee01b3dd099a84454736c5ce4"} Jul 14 07:50:30.700363 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.700335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fkfm9" event={"ID":"deca4ba6-7565-449f-9171-c52a407eae31","Type":"ContainerStarted","Data":"cfc34a5d344a9eb28db873e90b9b45e3833c6f3d64d148e49f98c733ef7eb111"} Jul 14 07:50:30.701487 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.701441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:30.701843 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.701693 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zsg52" Jul 14 07:50:30.717950 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:30.717885 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fkfm9" podStartSLOduration=5.4745396 podStartE2EDuration="23.717869979s" totalImagesPullingTime="18.243330379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:30.717351119 +0000 UTC m=+23.745496645" watchObservedRunningTime="2026-07-14 07:50:30.717869979 +0000 UTC m=+23.746015505" Jul 14 07:50:31.587694 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.587464 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:31.587917 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.587532 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:31.587917 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.587564 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:31.587917 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:31.587885 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:31.588087 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:31.588004 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:31.588136 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:31.588093 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:31.704282 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.704249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" event={"ID":"298aaa8a-ffe3-481d-8562-0547fcb19a77","Type":"ContainerStarted","Data":"94123f49e4d07c53ed9fb26a64fcf73a1c1e20350da1411e5af847ac179d464f"} Jul 14 07:50:31.707867 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.707838 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"c40be54be4485767a17c5d38ffca96e1d9f8ef2e1f413096dfd539111872bf48"} Jul 14 07:50:31.727465 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:31.727373 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tppxk" podStartSLOduration=12.357036448 podStartE2EDuration="24.727358596s" totalImagesPullingTime="12.370322148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:31.726780051 +0000 UTC m=+24.754925591" watchObservedRunningTime="2026-07-14 07:50:31.727358596 +0000 UTC m=+24.755504123" Jul 14 07:50:33.587563 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:33.587529 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:33.588218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:33.587545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:33.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:33.587669 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:33.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:33.587736 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:33.588218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:33.587781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:33.588218 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:33.587915 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:34.718829 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.718611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" event={"ID":"2c1600a2-277c-49b6-b8a6-f191bd32bb8a","Type":"ContainerStarted","Data":"6341478c9ea5aa809678b0dc536bef378e5c7f11508edbd5503c849c4b1cf445"} Jul 14 07:50:34.719524 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.718876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:34.720456 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.720425 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="fe0ef25fe112c65d8d3955facdc161e1731cbcc9aca018d4258b9454f1afec04" exitCode=0 Jul 14 07:50:34.720558 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.720457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"fe0ef25fe112c65d8d3955facdc161e1731cbcc9aca018d4258b9454f1afec04"} Jul 14 07:50:34.735192 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.735169 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:34.748059 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:34.748017 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" podStartSLOduration=9.404681938 podStartE2EDuration="27.748004666s" totalImagesPullingTime="18.343322728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:34.747700026 +0000 UTC m=+27.775845552" watchObservedRunningTime="2026-07-14 07:50:34.748004666 +0000 UTC m=+27.776150193" Jul 14 07:50:35.591140 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.591108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:35.591140 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.591140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:35.591437 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:35.591227 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:35.591437 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.591275 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:35.591437 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:35.591388 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:35.591542 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:35.591498 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:35.723444 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.723418 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:35.723848 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.723498 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:35.738574 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:35.738547 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:50:36.727482 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:36.727451 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="c5f94595c49a94e3fab35780b62a6f0e2e101b5401dcb0c3c23df2a963c8469f" exitCode=0 Jul 14 07:50:36.727891 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:36.727536 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"c5f94595c49a94e3fab35780b62a6f0e2e101b5401dcb0c3c23df2a963c8469f"} Jul 14 07:50:37.590466 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:37.590440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:37.590649 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:37.590518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:37.590649 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:37.590524 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:37.590649 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:37.590447 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:37.590649 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:37.590607 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:37.590876 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:37.590684 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:38.734258 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:38.734224 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="8eac4f701acd87ba0a50f4be41dc009a091cf89a543d768a1707d58a772321db" exitCode=0 Jul 14 07:50:38.734258 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:38.734256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"8eac4f701acd87ba0a50f4be41dc009a091cf89a543d768a1707d58a772321db"} Jul 14 07:50:39.588179 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:39.588137 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:39.588347 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:39.588141 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:39.588347 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:39.588300 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:39.588467 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:39.588355 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:39.588467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:39.588151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:39.588467 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:39.588446 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:41.180585 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.180547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:41.181040 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.180599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:41.181040 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.180726 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:41.181040 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.180729 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:41.181040 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.180781 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret podName:0de23af4-ddf6-481f-897b-9cb274054915 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:13.180769108 +0000 UTC m=+66.208914613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret") pod "global-pull-secret-syncer-j45vv" (UID: "0de23af4-ddf6-481f-897b-9cb274054915") : object "kube-system"/"original-pull-secret" not registered Jul 14 07:50:41.181040 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.180796 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs podName:7442787c-78a0-4115-9881-25a4a8c86d6d nodeName:}" failed. No retries permitted until 2026-07-14 07:51:13.180789887 +0000 UTC m=+66.208935392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs") pod "network-metrics-daemon-5bk54" (UID: "7442787c-78a0-4115-9881-25a4a8c86d6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 07:50:41.281666 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.281625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:41.281861 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.281827 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 07:50:41.281861 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.281855 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 07:50:41.281978 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.281868 2556 projected.go:196] Error preparing data for projected volume kube-api-access-g7hhh for pod openshift-network-diagnostics/network-check-target-z56lr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:41.281978 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.281925 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh podName:81f679f0-fc22-405a-b749-7c9b66751093 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:13.28190814 +0000 UTC m=+66.310053645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7hhh" (UniqueName: "kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh") pod "network-check-target-z56lr" (UID: "81f679f0-fc22-405a-b749-7c9b66751093") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 07:50:41.591080 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.591051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:41.591285 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.591169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:41.591285 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.591177 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:41.591285 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:41.591203 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:41.591453 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.591293 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:41.591453 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:41.591392 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:42.745925 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:42.745885 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="af4a1bf525467392eb3eb877ed8cdbc090b02b0b524ffc9145d66ef50d98002b" exitCode=0 Jul 14 07:50:42.745925 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:42.745927 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"af4a1bf525467392eb3eb877ed8cdbc090b02b0b524ffc9145d66ef50d98002b"} Jul 14 07:50:43.590538 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:43.590360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:43.590707 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:43.590407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:43.590707 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:43.590619 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:43.590707 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:43.590407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:43.590707 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:43.590677 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:43.590900 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:43.590734 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:43.750475 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:43.750445 2556 generic.go:356] "Generic (PLEG): container finished" podID="dda8640c-cfe2-48a6-9b0b-76703beaebc9" containerID="1205b91b98f494924d2c2d4a8a70c7f79fb38024f1f4c4f2148e3b35e8fba0e6" exitCode=0 Jul 14 07:50:43.750886 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:43.750514 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerDied","Data":"1205b91b98f494924d2c2d4a8a70c7f79fb38024f1f4c4f2148e3b35e8fba0e6"} Jul 14 07:50:44.755885 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:44.755851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" event={"ID":"dda8640c-cfe2-48a6-9b0b-76703beaebc9","Type":"ContainerStarted","Data":"62bf05f123e124f62ae77df2e9723b0bb85ec4aa6b8f318067f4a5d2ff5f9b08"} Jul 14 07:50:44.787269 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:44.787219 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f2s9t" podStartSLOduration=9.231487682 podStartE2EDuration="37.78720268s" totalImagesPullingTime="28.555714998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:44.786094385 +0000 UTC m=+37.814239933" watchObservedRunningTime="2026-07-14 07:50:44.78720268 +0000 UTC m=+37.815348211" Jul 14 07:50:45.587478 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:45.587444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:45.587478 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:45.587472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:45.587742 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:45.587472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:45.587742 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:45.587549 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:45.587742 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:45.587698 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:45.587924 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:45.587789 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:46.135660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.135623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j45vv"] Jul 14 07:50:46.136375 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.135737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:46.136375 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:46.135879 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:46.136375 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.136365 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z56lr"] Jul 14 07:50:46.136487 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.136436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:46.136525 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:46.136502 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:46.138167 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.138143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bk54"] Jul 14 07:50:46.138292 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:46.138218 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:46.138356 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:46.138313 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:47.591074 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:47.591021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:47.591657 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:47.591376 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:47.592715 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:47.591931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:47.592715 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:47.592510 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:47.592958 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:47.592786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:47.593012 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:47.592983 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:49.587786 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.587753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:49.588233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.587753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:49.588233 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:49.587879 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j45vv" podUID="0de23af4-ddf6-481f-897b-9cb274054915" Jul 14 07:50:49.588233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.587766 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:49.588233 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:49.587930 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56lr" podUID="81f679f0-fc22-405a-b749-7c9b66751093" Jul 14 07:50:49.588233 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:50:49.588064 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bk54" podUID="7442787c-78a0-4115-9881-25a4a8c86d6d" Jul 14 07:50:49.769585 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.769561 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-86.ec2.internal" event="NodeReady" Jul 14 07:50:49.769766 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.769679 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 07:50:49.804905 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.804869 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c9fcff9b-2d85v"] Jul 14 07:50:49.832145 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.831669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.832397 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.831564 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-stlhf"] Jul 14 07:50:49.834540 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.834359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 07:50:49.834646 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.834365 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 07:50:49.834646 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.834407 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtm4v\"" Jul 14 07:50:49.834780 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.834479 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 07:50:49.840696 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.840324 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 07:50:49.847581 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.847560 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zbpfm"] Jul 14 07:50:49.847683 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.847668 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:49.850177 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.850115 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lxlt\"" Jul 14 07:50:49.850300 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.850245 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 07:50:49.850300 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.850269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 07:50:49.865631 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.865599 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c9fcff9b-2d85v"] Jul 14 07:50:49.865631 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.865636 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-stlhf"] Jul 14 07:50:49.865840 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.865658 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbpfm"] Jul 14 07:50:49.865840 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.865671 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z4ts7"] Jul 14 07:50:49.865840 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.865708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:49.868030 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.867995 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 07:50:49.868030 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.868001 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 07:50:49.868215 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.868041 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 07:50:49.868215 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.868133 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5nzm8\"" Jul 14 07:50:49.891964 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.891932 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4ts7"] Jul 14 07:50:49.892118 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.892045 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:49.894991 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.894959 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 07:50:49.895390 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.895360 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 07:50:49.895510 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.895451 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zq59h\"" Jul 14 07:50:49.895510 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.895470 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 07:50:49.895510 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.895501 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 07:50:49.940928 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.940887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-config-volume\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:49.940928 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.940931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-installation-pull-secrets\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.940957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvfv\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-kube-api-access-6kvfv\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8v6b\" (UniqueName: \"kubernetes.io/projected/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-kube-api-access-b8v6b\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-registry-tls\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/176746ed-cfbc-40e0-9316-28a803c8f920-ca-trust-extracted\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-registry-certificates\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-trusted-ca\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941355 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-tmp-dir\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:49.941355 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-metrics-tls\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:49.941355 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-image-registry-private-configuration\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:49.941355 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:49.941295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-bound-sa-token\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042206 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-trusted-ca\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042206 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-crio-socket\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l2bq\" (UniqueName: \"kubernetes.io/projected/3005873c-318a-4776-b0eb-421555f8d20a-kube-api-access-6l2bq\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-tmp-dir\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-metrics-tls\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-image-registry-private-configuration\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3005873c-318a-4776-b0eb-421555f8d20a-cert\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.042414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-bound-sa-token\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042422 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-data-volume\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-config-volume\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-installation-pull-secrets\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvfv\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-kube-api-access-6kvfv\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8v6b\" (UniqueName: \"kubernetes.io/projected/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-kube-api-access-b8v6b\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-registry-tls\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/176746ed-cfbc-40e0-9316-28a803c8f920-ca-trust-extracted\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-registry-certificates\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042730 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7lzj\" (UniqueName: \"kubernetes.io/projected/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-api-access-w7lzj\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.042934 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.042798 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-tmp-dir\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.043574 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.043545 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-trusted-ca\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.043685 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.043590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/176746ed-cfbc-40e0-9316-28a803c8f920-registry-certificates\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.043845 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.043824 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/176746ed-cfbc-40e0-9316-28a803c8f920-ca-trust-extracted\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.044046 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.044031 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-config-volume\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.046483 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.046459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-installation-pull-secrets\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.046483 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.046474 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-metrics-tls\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.046595 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.046480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/176746ed-cfbc-40e0-9316-28a803c8f920-image-registry-private-configuration\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.046595 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.046575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-registry-tls\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.053125 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.053093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8v6b\" (UniqueName: \"kubernetes.io/projected/a71e9481-23c9-4a7f-9c44-f3bc5b6d0602-kube-api-access-b8v6b\") pod \"dns-default-stlhf\" (UID: \"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602\") " pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.053228 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.053096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-bound-sa-token\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.053716 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.053694 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvfv\" (UniqueName: \"kubernetes.io/projected/176746ed-cfbc-40e0-9316-28a803c8f920-kube-api-access-6kvfv\") pod \"image-registry-59c9fcff9b-2d85v\" (UID: \"176746ed-cfbc-40e0-9316-28a803c8f920\") " pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.143523 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143417 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-data-volume\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7lzj\" (UniqueName: \"kubernetes.io/projected/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-api-access-w7lzj\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-crio-socket\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.143660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l2bq\" (UniqueName: \"kubernetes.io/projected/3005873c-318a-4776-b0eb-421555f8d20a-kube-api-access-6l2bq\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.143978 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3005873c-318a-4776-b0eb-421555f8d20a-cert\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.143978 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143909 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-data-volume\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.144081 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.143973 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-crio-socket\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.144234 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.144217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.145952 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.145927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.146087 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.146072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3005873c-318a-4776-b0eb-421555f8d20a-cert\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.151818 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.151783 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l2bq\" (UniqueName: \"kubernetes.io/projected/3005873c-318a-4776-b0eb-421555f8d20a-kube-api-access-6l2bq\") pod \"ingress-canary-zbpfm\" (UID: \"3005873c-318a-4776-b0eb-421555f8d20a\") " pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.156606 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.156591 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:50.160014 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.159997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7lzj\" (UniqueName: \"kubernetes.io/projected/36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e-kube-api-access-w7lzj\") pod \"insights-runtime-extractor-z4ts7\" (UID: \"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e\") " pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.174337 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.174300 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zbpfm" Jul 14 07:50:50.200632 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.200603 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4ts7" Jul 14 07:50:50.398681 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.398593 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zbpfm"] Jul 14 07:50:50.402840 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:50.402796 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3005873c_318a_4776_b0eb_421555f8d20a.slice/crio-1cfc21ce8798bcbdd8f15873b6aa69e921e094c53e198c8e03598137499c4914 WatchSource:0}: Error finding container 1cfc21ce8798bcbdd8f15873b6aa69e921e094c53e198c8e03598137499c4914: Status 404 returned error can't find the container with id 1cfc21ce8798bcbdd8f15873b6aa69e921e094c53e198c8e03598137499c4914 Jul 14 07:50:50.405479 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.405412 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c9fcff9b-2d85v"] Jul 14 07:50:50.406344 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.406165 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-stlhf"] Jul 14 07:50:50.410332 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:50.410310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176746ed_cfbc_40e0_9316_28a803c8f920.slice/crio-36e1238bab06e688192af6de0622098e80b58e1ca22c55434d60dc9421cc35e0 WatchSource:0}: Error finding container 36e1238bab06e688192af6de0622098e80b58e1ca22c55434d60dc9421cc35e0: Status 404 returned error can't find the container with id 36e1238bab06e688192af6de0622098e80b58e1ca22c55434d60dc9421cc35e0 Jul 14 07:50:50.411547 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:50.411520 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71e9481_23c9_4a7f_9c44_f3bc5b6d0602.slice/crio-dddff3a5902a8b1c54e850885668e022277d51558ac1987a064ef3313261c595 WatchSource:0}: Error finding container dddff3a5902a8b1c54e850885668e022277d51558ac1987a064ef3313261c595: Status 404 returned error can't find the container with id dddff3a5902a8b1c54e850885668e022277d51558ac1987a064ef3313261c595 Jul 14 07:50:50.412255 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.412234 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4ts7"] Jul 14 07:50:50.415299 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:50:50.415279 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ea3bee_6aaa_46aa_b1fc_e0dddac1b40e.slice/crio-bebd73c57ccbdd79cc3c70b4d9dac20c2a40abca66ad428b9b154c35357061e5 WatchSource:0}: Error finding container bebd73c57ccbdd79cc3c70b4d9dac20c2a40abca66ad428b9b154c35357061e5: Status 404 returned error can't find the container with id bebd73c57ccbdd79cc3c70b4d9dac20c2a40abca66ad428b9b154c35357061e5 Jul 14 07:50:50.771925 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.771882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbpfm" event={"ID":"3005873c-318a-4776-b0eb-421555f8d20a","Type":"ContainerStarted","Data":"1cfc21ce8798bcbdd8f15873b6aa69e921e094c53e198c8e03598137499c4914"} Jul 14 07:50:50.773033 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.772994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-stlhf" event={"ID":"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602","Type":"ContainerStarted","Data":"dddff3a5902a8b1c54e850885668e022277d51558ac1987a064ef3313261c595"} Jul 14 07:50:50.774230 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.774195 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4ts7" event={"ID":"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e","Type":"ContainerStarted","Data":"bebd73c57ccbdd79cc3c70b4d9dac20c2a40abca66ad428b9b154c35357061e5"} Jul 14 07:50:50.775507 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.775488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" event={"ID":"176746ed-cfbc-40e0-9316-28a803c8f920","Type":"ContainerStarted","Data":"d380a6d70fc535970950aea6ce74b9fe275754f524670dc09226e65436def9bf"} Jul 14 07:50:50.775635 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.775517 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" event={"ID":"176746ed-cfbc-40e0-9316-28a803c8f920","Type":"ContainerStarted","Data":"36e1238bab06e688192af6de0622098e80b58e1ca22c55434d60dc9421cc35e0"} Jul 14 07:50:50.775635 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.775624 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:50:50.795770 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:50.795706 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" podStartSLOduration=5.7956840320000005 podStartE2EDuration="5.795684032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:50.794926073 +0000 UTC m=+43.823071605" watchObservedRunningTime="2026-07-14 07:50:50.795684032 +0000 UTC m=+43.823829556" Jul 14 07:50:51.589529 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.587961 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:50:51.589529 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.588602 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:50:51.589529 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.589093 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:50:51.592764 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.592040 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 07:50:51.595064 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.594476 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 07:50:51.595064 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.594641 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\"" Jul 14 07:50:51.595064 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.594687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 07:50:51.595064 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.594858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 07:50:51.595064 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:51.594876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\"" Jul 14 07:50:56.795885 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:56.795847 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zbpfm" event={"ID":"3005873c-318a-4776-b0eb-421555f8d20a","Type":"ContainerStarted","Data":"bfbab6360c2e3274faf884ae629fe6e0e751bd56c33f8f0274710dece4fc9f1a"} Jul 14 07:50:56.798102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:56.798072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-stlhf" event={"ID":"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602","Type":"ContainerStarted","Data":"3d5e2bfacb1ecc5376eeba868c8ab92e177d98a1f5cd6119418980c78aab02fb"} Jul 14 07:50:56.811383 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:56.811323 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zbpfm" podStartSLOduration=1.5269037189999999 podStartE2EDuration="7.811303466s" totalImagesPullingTime="6.284399747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:56.810212361 +0000 UTC m=+49.838357889" watchObservedRunningTime="2026-07-14 07:50:56.811303466 +0000 UTC m=+49.839448994" Jul 14 07:50:57.802664 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:57.802457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-stlhf" event={"ID":"a71e9481-23c9-4a7f-9c44-f3bc5b6d0602","Type":"ContainerStarted","Data":"793c961feabe61e61d76bf6e4b98029146848efc542c4456155dff7786027be1"} Jul 14 07:50:57.803072 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:57.802698 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-stlhf" Jul 14 07:50:57.803850 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:57.803829 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4ts7" event={"ID":"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e","Type":"ContainerStarted","Data":"7ffdd149d788d5c3aedee3aac98574f3c3401182b3112ec4bc63016276f569c9"} Jul 14 07:50:57.819881 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:57.819830 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-stlhf" podStartSLOduration=2.543618785 podStartE2EDuration="8.819785383s" totalImagesPullingTime="6.276166598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:50:57.819718132 +0000 UTC m=+50.847863658" watchObservedRunningTime="2026-07-14 07:50:57.819785383 +0000 UTC m=+50.847930893" Jul 14 07:50:58.809373 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:50:58.809334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4ts7" event={"ID":"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e","Type":"ContainerStarted","Data":"1cb501a4770e19daaf2bc89b097d54124bc2326eb9cc12811e0a9d87e5bcd159"} Jul 14 07:51:00.818521 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:00.818437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4ts7" event={"ID":"36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e","Type":"ContainerStarted","Data":"7178ff8547591df422232730bdc6d403c30f67a011ccaabb8f59f0f5e49191ff"} Jul 14 07:51:00.836674 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:00.836630 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z4ts7" podStartSLOduration=1.892672344 podStartE2EDuration="11.836614588s" totalImagesPullingTime="9.943942244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:00.836001154 +0000 UTC m=+53.864146681" watchObservedRunningTime="2026-07-14 07:51:00.836614588 +0000 UTC m=+53.864760115" Jul 14 07:51:07.739369 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.739335 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dshcq" Jul 14 07:51:07.771409 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.771375 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb"] Jul 14 07:51:07.774185 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.774170 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:07.776547 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.776528 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vd6jc\"" Jul 14 07:51:07.776660 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.776525 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 07:51:07.783354 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.783331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb"] Jul 14 07:51:07.811234 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.811208 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-stlhf" Jul 14 07:51:07.883160 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.883129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-thdsb\" (UID: \"03b4f929-1af4-487e-a4dd-98e91c3c2170\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:07.984085 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:07.984043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-thdsb\" (UID: \"03b4f929-1af4-487e-a4dd-98e91c3c2170\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:07.984231 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:07.984184 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 14 07:51:07.984269 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:07.984251 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates podName:03b4f929-1af4-487e-a4dd-98e91c3c2170 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:08.48423534 +0000 UTC m=+61.512380850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-thdsb" (UID: "03b4f929-1af4-487e-a4dd-98e91c3c2170") : secret "prometheus-operator-admission-webhook-tls" not found Jul 14 07:51:08.489543 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:08.489507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-thdsb\" (UID: \"03b4f929-1af4-487e-a4dd-98e91c3c2170\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:08.493484 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:08.493454 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03b4f929-1af4-487e-a4dd-98e91c3c2170-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-thdsb\" (UID: \"03b4f929-1af4-487e-a4dd-98e91c3c2170\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:08.682881 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:08.682849 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:08.809935 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:08.809892 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb"] Jul 14 07:51:08.814646 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:08.814610 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b4f929_1af4_487e_a4dd_98e91c3c2170.slice/crio-c2b680b6b13258ebc2f66a287d7d39f0826f82d15ed87af5a162027deb6b1e24 WatchSource:0}: Error finding container c2b680b6b13258ebc2f66a287d7d39f0826f82d15ed87af5a162027deb6b1e24: Status 404 returned error can't find the container with id c2b680b6b13258ebc2f66a287d7d39f0826f82d15ed87af5a162027deb6b1e24 Jul 14 07:51:08.842798 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:08.842766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" event={"ID":"03b4f929-1af4-487e-a4dd-98e91c3c2170","Type":"ContainerStarted","Data":"c2b680b6b13258ebc2f66a287d7d39f0826f82d15ed87af5a162027deb6b1e24"} Jul 14 07:51:10.849796 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:10.849747 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" event={"ID":"03b4f929-1af4-487e-a4dd-98e91c3c2170","Type":"ContainerStarted","Data":"50ce2b57800a28b6be5c93903dd5a274a0b9ecb8dcbf59c41bb8832fb10f0683"} Jul 14 07:51:10.850153 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:10.849946 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:10.854467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:10.854446 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" Jul 14 07:51:10.876152 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:10.876111 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-thdsb" podStartSLOduration=2.709692616 podStartE2EDuration="3.876096523s" totalImagesPullingTime="1.166403907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:10.8759501 +0000 UTC m=+63.904095628" watchObservedRunningTime="2026-07-14 07:51:10.876096523 +0000 UTC m=+63.904242084" Jul 14 07:51:11.783974 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:11.783942 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c9fcff9b-2d85v" Jul 14 07:51:13.222518 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.222474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:51:13.222954 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.222530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:51:13.225131 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.225111 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 07:51:13.225794 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.225777 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 07:51:13.234674 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.234653 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7442787c-78a0-4115-9881-25a4a8c86d6d-metrics-certs\") pod \"network-metrics-daemon-5bk54\" (UID: \"7442787c-78a0-4115-9881-25a4a8c86d6d\") " pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:51:13.234783 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.234765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0de23af4-ddf6-481f-897b-9cb274054915-original-pull-secret\") pod \"global-pull-secret-syncer-j45vv\" (UID: \"0de23af4-ddf6-481f-897b-9cb274054915\") " pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:51:13.323592 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.323560 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:51:13.326121 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.326104 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 07:51:13.336623 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.336608 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 07:51:13.346679 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.346652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hhh\" (UniqueName: \"kubernetes.io/projected/81f679f0-fc22-405a-b749-7c9b66751093-kube-api-access-g7hhh\") pod \"network-check-target-z56lr\" (UID: \"81f679f0-fc22-405a-b749-7c9b66751093\") " pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:51:13.510452 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.510365 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jjcpw\"" Jul 14 07:51:13.518305 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.518285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:51:13.519073 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.519058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skvf2\"" Jul 14 07:51:13.526553 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.526525 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j45vv" Jul 14 07:51:13.527610 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.527594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bk54" Jul 14 07:51:13.671357 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.671325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z56lr"] Jul 14 07:51:13.675062 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:13.675036 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f679f0_fc22_405a_b749_7c9b66751093.slice/crio-65454fe243dc28a1108b712b7a71da7e448d58e0bdda37bde376f0706af53a19 WatchSource:0}: Error finding container 65454fe243dc28a1108b712b7a71da7e448d58e0bdda37bde376f0706af53a19: Status 404 returned error can't find the container with id 65454fe243dc28a1108b712b7a71da7e448d58e0bdda37bde376f0706af53a19 Jul 14 07:51:13.860610 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.860571 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z56lr" event={"ID":"81f679f0-fc22-405a-b749-7c9b66751093","Type":"ContainerStarted","Data":"65454fe243dc28a1108b712b7a71da7e448d58e0bdda37bde376f0706af53a19"} Jul 14 07:51:13.895309 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.895141 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bk54"] Jul 14 07:51:13.896179 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:13.896080 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j45vv"] Jul 14 07:51:13.897885 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:13.897858 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de23af4_ddf6_481f_897b_9cb274054915.slice/crio-4a97ea9b34bb43bdb7b9597b63d81ed108e9ef4b8e7f7bf0daf3f19685594f09 WatchSource:0}: Error finding container 4a97ea9b34bb43bdb7b9597b63d81ed108e9ef4b8e7f7bf0daf3f19685594f09: Status 404 returned error can't find the container with id 4a97ea9b34bb43bdb7b9597b63d81ed108e9ef4b8e7f7bf0daf3f19685594f09 Jul 14 07:51:13.898354 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:13.898335 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7442787c_78a0_4115_9881_25a4a8c86d6d.slice/crio-380e2f21598b67be067b65f43915c7b774bce00d52ca89cac89cfe4de711b463 WatchSource:0}: Error finding container 380e2f21598b67be067b65f43915c7b774bce00d52ca89cac89cfe4de711b463: Status 404 returned error can't find the container with id 380e2f21598b67be067b65f43915c7b774bce00d52ca89cac89cfe4de711b463 Jul 14 07:51:14.866487 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:14.866456 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bk54" event={"ID":"7442787c-78a0-4115-9881-25a4a8c86d6d","Type":"ContainerStarted","Data":"380e2f21598b67be067b65f43915c7b774bce00d52ca89cac89cfe4de711b463"} Jul 14 07:51:14.867714 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:14.867684 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j45vv" event={"ID":"0de23af4-ddf6-481f-897b-9cb274054915","Type":"ContainerStarted","Data":"4a97ea9b34bb43bdb7b9597b63d81ed108e9ef4b8e7f7bf0daf3f19685594f09"} Jul 14 07:51:15.877311 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:15.876983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bk54" event={"ID":"7442787c-78a0-4115-9881-25a4a8c86d6d","Type":"ContainerStarted","Data":"66bdc4bd78d55391120419e9256066b14a4e8d024a50ca2837c98e0e1176cf0d"} Jul 14 07:51:15.877311 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:15.877049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bk54" event={"ID":"7442787c-78a0-4115-9881-25a4a8c86d6d","Type":"ContainerStarted","Data":"1d4860fb761272990e086c6f231e7d8445a67b45978357a69f14e24f41d94d61"} Jul 14 07:51:15.895351 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:15.895292 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5bk54" podStartSLOduration=67.898266923 podStartE2EDuration="1m8.895272805s" totalImagesPullingTime="997.005882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:15.894250525 +0000 UTC m=+68.922396056" watchObservedRunningTime="2026-07-14 07:51:15.895272805 +0000 UTC m=+68.923418339" Jul 14 07:51:18.890394 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:18.890324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z56lr" event={"ID":"81f679f0-fc22-405a-b749-7c9b66751093","Type":"ContainerStarted","Data":"6867c15bc4c2328258ba7f18b7a6ac58522ee07ecf1c4a6a79ad0c54c3085577"} Jul 14 07:51:18.890898 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:18.890431 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:51:18.892423 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:18.892389 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j45vv" event={"ID":"0de23af4-ddf6-481f-897b-9cb274054915","Type":"ContainerStarted","Data":"a0a628b8a357a9c8e5102ae821d03c1d18d0feb4503b6089d6b732e23df17760"} Jul 14 07:51:18.922932 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:18.922881 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z56lr" podStartSLOduration=67.403386725 podStartE2EDuration="1m11.922865983s" totalImagesPullingTime="4.519479258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:18.920917595 +0000 UTC m=+71.949063122" watchObservedRunningTime="2026-07-14 07:51:18.922865983 +0000 UTC m=+71.951011540" Jul 14 07:51:18.942924 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:18.942874 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j45vv" podStartSLOduration=67.642362504 podStartE2EDuration="1m11.942858551s" totalImagesPullingTime="4.300496047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 07:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:18.941509774 +0000 UTC m=+71.969655300" watchObservedRunningTime="2026-07-14 07:51:18.942858551 +0000 UTC m=+71.971004076" Jul 14 07:51:19.187889 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.187795 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b"] Jul 14 07:51:19.189832 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.189797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.192957 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.192933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 07:51:19.194236 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.194214 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 07:51:19.194381 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.194354 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 07:51:19.194381 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.194368 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 07:51:19.194381 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.194354 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 07:51:19.194556 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.194401 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hqsxv\"" Jul 14 07:51:19.205942 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.205923 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b"] Jul 14 07:51:19.223101 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.223076 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rrqdr"] Jul 14 07:51:19.225331 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.225316 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.228939 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.228921 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdj8g\"" Jul 14 07:51:19.229307 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.229292 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 07:51:19.229549 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.229534 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 07:51:19.229682 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.229667 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 07:51:19.269077 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-sys\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269202 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-textfile\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269202 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.269202 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269304 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4rnq\" (UniqueName: \"kubernetes.io/projected/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-kube-api-access-p4rnq\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269304 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269304 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8029ea26-c0d1-4b63-9743-4da858fb9f72-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.269395 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-wtmp\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269395 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269341 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlxh\" (UniqueName: \"kubernetes.io/projected/8029ea26-c0d1-4b63-9743-4da858fb9f72-kube-api-access-qrlxh\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.269395 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269361 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269395 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269386 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-root\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.269513 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269412 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.269513 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.269432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-metrics-client-ca\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369692 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8029ea26-c0d1-4b63-9743-4da858fb9f72-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.369692 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-wtmp\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlxh\" (UniqueName: \"kubernetes.io/projected/8029ea26-c0d1-4b63-9743-4da858fb9f72-kube-api-access-qrlxh\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-root\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369822 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-metrics-client-ca\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-sys\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369865 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-wtmp\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369925 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-sys\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369872 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-textfile\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.369965 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:19.369940 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:19.370002 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls podName:8029ea26-c0d1-4b63-9743-4da858fb9f72 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:19.869980637 +0000 UTC m=+72.898126152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-t8b6b" (UID: "8029ea26-c0d1-4b63-9743-4da858fb9f72") : secret "openshift-state-metrics-tls" not found Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.369865 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-root\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4rnq\" (UniqueName: \"kubernetes.io/projected/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-kube-api-access-p4rnq\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:19.370201 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:51:19.370247 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls podName:c2ee72e8-9f8e-4f4a-8287-ce87f79568e2 nodeName:}" failed. No retries permitted until 2026-07-14 07:51:19.870231698 +0000 UTC m=+72.898377208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls") pod "node-exporter-rrqdr" (UID: "c2ee72e8-9f8e-4f4a-8287-ce87f79568e2") : secret "node-exporter-tls" not found Jul 14 07:51:19.370417 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-textfile\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370773 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370773 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370537 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-metrics-client-ca\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.370773 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.370549 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8029ea26-c0d1-4b63-9743-4da858fb9f72-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.372432 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.372407 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.372519 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.372433 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.379711 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.379679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4rnq\" (UniqueName: \"kubernetes.io/projected/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-kube-api-access-p4rnq\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.379915 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.379899 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlxh\" (UniqueName: \"kubernetes.io/projected/8029ea26-c0d1-4b63-9743-4da858fb9f72-kube-api-access-qrlxh\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.874256 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.874222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.874430 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.874294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:19.876560 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.876534 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2ee72e8-9f8e-4f4a-8287-ce87f79568e2-node-exporter-tls\") pod \"node-exporter-rrqdr\" (UID: \"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2\") " pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:19.876705 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:19.876690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8029ea26-c0d1-4b63-9743-4da858fb9f72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-t8b6b\" (UID: \"8029ea26-c0d1-4b63-9743-4da858fb9f72\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:20.099154 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.099103 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" Jul 14 07:51:20.133775 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.133704 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrqdr" Jul 14 07:51:20.149158 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:20.148986 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ee72e8_9f8e_4f4a_8287_ce87f79568e2.slice/crio-1ff4cae2feef6c67bd6cfe7e85276dcb9123fe2976da787cb8373d37492c62e6 WatchSource:0}: Error finding container 1ff4cae2feef6c67bd6cfe7e85276dcb9123fe2976da787cb8373d37492c62e6: Status 404 returned error can't find the container with id 1ff4cae2feef6c67bd6cfe7e85276dcb9123fe2976da787cb8373d37492c62e6 Jul 14 07:51:20.236374 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.236344 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b"] Jul 14 07:51:20.239175 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:20.239149 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8029ea26_c0d1_4b63_9743_4da858fb9f72.slice/crio-419092624e572b71c5f3483ebdb4b0460e9ed21d99d723f09429bd1961fc1500 WatchSource:0}: Error finding container 419092624e572b71c5f3483ebdb4b0460e9ed21d99d723f09429bd1961fc1500: Status 404 returned error can't find the container with id 419092624e572b71c5f3483ebdb4b0460e9ed21d99d723f09429bd1961fc1500 Jul 14 07:51:20.305682 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.305655 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 07:51:20.310398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.310375 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.312860 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.312825 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 07:51:20.313050 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313003 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 07:51:20.313132 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313044 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 07:51:20.313201 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313183 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 07:51:20.313341 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313327 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 07:51:20.313422 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313406 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 07:51:20.313572 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.313555 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 07:51:20.314323 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.314306 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 07:51:20.314419 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.314310 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ckhx2\"" Jul 14 07:51:20.314475 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.314424 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 07:51:20.330706 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.330686 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 07:51:20.377839 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.377981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jrr\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-kube-api-access-z8jrr\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-out\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-web-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.378317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.378221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479109 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479109 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jrr\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-kube-api-access-z8jrr\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479527 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-out\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479527 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479527 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479527 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479718 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-web-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479778 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479778 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.479951 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.479932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.480634 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.480607 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c3e7aad-1105-4bf8-b5e4-904850e4e116-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.482578 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.482285 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.482683 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.482629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.482870 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.482843 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.482992 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.482963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-out\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.483057 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.483030 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-config-volume\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.483639 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.483612 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.483639 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.483625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.483795 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.483744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-web-config\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.484032 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.484013 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9c3e7aad-1105-4bf8-b5e4-904850e4e116-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.487075 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.487057 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jrr\" (UniqueName: \"kubernetes.io/projected/9c3e7aad-1105-4bf8-b5e4-904850e4e116-kube-api-access-z8jrr\") pod \"alertmanager-main-0\" (UID: \"9c3e7aad-1105-4bf8-b5e4-904850e4e116\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.634721 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.634689 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 07:51:20.791648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.791548 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 07:51:20.795271 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:20.795245 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3e7aad_1105_4bf8_b5e4_904850e4e116.slice/crio-f6e03158c610da38065ad2abbb7b0fb826be420583a3c6d8f40b802e1c42975e WatchSource:0}: Error finding container f6e03158c610da38065ad2abbb7b0fb826be420583a3c6d8f40b802e1c42975e: Status 404 returned error can't find the container with id f6e03158c610da38065ad2abbb7b0fb826be420583a3c6d8f40b802e1c42975e Jul 14 07:51:20.899991 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.899944 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"f6e03158c610da38065ad2abbb7b0fb826be420583a3c6d8f40b802e1c42975e"} Jul 14 07:51:20.902403 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.902366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" event={"ID":"8029ea26-c0d1-4b63-9743-4da858fb9f72","Type":"ContainerStarted","Data":"89c26725431ca71077564ca11b63d4bdad020520ec19d451ff30674f57c47458"} Jul 14 07:51:20.902567 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.902437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" event={"ID":"8029ea26-c0d1-4b63-9743-4da858fb9f72","Type":"ContainerStarted","Data":"fc1232659fff0650c1cf72fb1035b4439d47483e48451de142bb0ffe29f3beba"} Jul 14 07:51:20.902567 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.902471 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" event={"ID":"8029ea26-c0d1-4b63-9743-4da858fb9f72","Type":"ContainerStarted","Data":"419092624e572b71c5f3483ebdb4b0460e9ed21d99d723f09429bd1961fc1500"} Jul 14 07:51:20.903787 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:20.903748 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrqdr" event={"ID":"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2","Type":"ContainerStarted","Data":"1ff4cae2feef6c67bd6cfe7e85276dcb9123fe2976da787cb8373d37492c62e6"} Jul 14 07:51:21.306902 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.306867 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn"] Jul 14 07:51:21.309194 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.309175 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.311726 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.311705 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 07:51:21.311886 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.311775 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9fqiglrtqf48l\"" Jul 14 07:51:21.312071 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.312053 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 07:51:21.312623 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.312608 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 07:51:21.312713 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.312625 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l78st\"" Jul 14 07:51:21.312713 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.312634 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 07:51:21.312713 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.312640 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 07:51:21.323271 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.323251 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn"] Jul 14 07:51:21.387150 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-grpc-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387255 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-metrics-client-ca\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387255 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjmm\" (UniqueName: \"kubernetes.io/projected/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-kube-api-access-5fjmm\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387361 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387405 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.387467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.387441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488003 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.487971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488142 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488289 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488340 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-grpc-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488392 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-metrics-client-ca\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488445 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.488490 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.488463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjmm\" (UniqueName: \"kubernetes.io/projected/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-kube-api-access-5fjmm\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.489209 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.489178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-metrics-client-ca\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.490708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.490676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.491211 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.491157 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.491498 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.491468 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-grpc-tls\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.491658 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.491635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.491868 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.491845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.492171 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.492147 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.496775 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.496752 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjmm\" (UniqueName: \"kubernetes.io/projected/3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5-kube-api-access-5fjmm\") pod \"thanos-querier-7857f8d8d4-dpwrn\" (UID: \"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5\") " pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.619954 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.619873 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:21.767207 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.767171 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn"] Jul 14 07:51:21.909712 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.909627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" event={"ID":"8029ea26-c0d1-4b63-9743-4da858fb9f72","Type":"ContainerStarted","Data":"c6dfd7bb84f7e315af667bcb16ba5f12bb48f437bdb1735a55ad6dd795e64951"} Jul 14 07:51:21.911362 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.911335 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2ee72e8-9f8e-4f4a-8287-ce87f79568e2" containerID="3c3ef293c97c7d1680e608467ae7a401c43e89aee6a69e162adcaa97226ba624" exitCode=0 Jul 14 07:51:21.911491 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.911402 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrqdr" event={"ID":"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2","Type":"ContainerDied","Data":"3c3ef293c97c7d1680e608467ae7a401c43e89aee6a69e162adcaa97226ba624"} Jul 14 07:51:21.927340 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:21.927290 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-t8b6b" podStartSLOduration=1.951245642 podStartE2EDuration="2.927272874s" totalImagesPullingTime="976.027232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:21.926841344 +0000 UTC m=+74.954986870" watchObservedRunningTime="2026-07-14 07:51:21.927272874 +0000 UTC m=+74.955418402" Jul 14 07:51:21.969522 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:21.969481 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1fbe16_5100_4ed9_b0c0_8c5d3be590b5.slice/crio-71eb2bb5798ff0ab80079ae4079d26f7d891623e27ecaf15ff63574748522a5c WatchSource:0}: Error finding container 71eb2bb5798ff0ab80079ae4079d26f7d891623e27ecaf15ff63574748522a5c: Status 404 returned error can't find the container with id 71eb2bb5798ff0ab80079ae4079d26f7d891623e27ecaf15ff63574748522a5c Jul 14 07:51:22.916938 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.916902 2556 generic.go:356] "Generic (PLEG): container finished" podID="9c3e7aad-1105-4bf8-b5e4-904850e4e116" containerID="c6afce8e08ff1bda687ced4836292339ca2ef9f246807d56b99d6aaa7e3c5211" exitCode=0 Jul 14 07:51:22.917373 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.917002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerDied","Data":"c6afce8e08ff1bda687ced4836292339ca2ef9f246807d56b99d6aaa7e3c5211"} Jul 14 07:51:22.919723 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.919701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrqdr" event={"ID":"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2","Type":"ContainerStarted","Data":"4d8c15acc8a76623cdf02b41c1e62002e39bbd218aa94830b2349f3dea419c54"} Jul 14 07:51:22.919853 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.919745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrqdr" event={"ID":"c2ee72e8-9f8e-4f4a-8287-ce87f79568e2","Type":"ContainerStarted","Data":"42b87c4a3e1413d009a4640b0d17856a218f98ccb8ca19172e5a2cb0f55cbe2a"} Jul 14 07:51:22.921579 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.921553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"71eb2bb5798ff0ab80079ae4079d26f7d891623e27ecaf15ff63574748522a5c"} Jul 14 07:51:22.958909 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:22.958862 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rrqdr" podStartSLOduration=2.7012145690000002 podStartE2EDuration="3.958847829s" totalImagesPullingTime="1.186848759s" totalInitContainerRuntime="70.784501ms" isStatefulPod=true podCreationTimestamp="2026-07-14 07:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:22.957467588 +0000 UTC m=+75.985613116" watchObservedRunningTime="2026-07-14 07:51:22.958847829 +0000 UTC m=+75.986993356" Jul 14 07:51:24.426264 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.426227 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn"] Jul 14 07:51:24.447364 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.447324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.453059 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.453032 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q6tw8\"" Jul 14 07:51:24.453059 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.453052 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 07:51:24.453264 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.453090 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 07:51:24.453264 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.453032 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 07:51:24.459254 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.459234 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 07:51:24.459357 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.459343 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 07:51:24.475648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.475616 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 07:51:24.478247 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.478223 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn"] Jul 14 07:51:24.514506 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjvl\" (UniqueName: \"kubernetes.io/projected/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-kube-api-access-dbjvl\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-metrics-client-ca\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-federate-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514648 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-serving-certs-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514752 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514752 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514752 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.514878 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.514759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615277 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-metrics-client-ca\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615433 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-federate-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615433 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-serving-certs-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615433 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615433 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615663 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615663 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.615663 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.615509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjvl\" (UniqueName: \"kubernetes.io/projected/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-kube-api-access-dbjvl\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.616217 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.616163 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-metrics-client-ca\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.616423 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.616395 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-serving-certs-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.616930 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.616891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.618694 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.618665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.618790 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.618671 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-secret-telemeter-client\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.618790 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.618701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-federate-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.618790 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.618731 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-telemeter-client-tls\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.625459 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.625439 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjvl\" (UniqueName: \"kubernetes.io/projected/1253f9dd-67a0-4d99-b3aa-cb889f7b1845-kube-api-access-dbjvl\") pod \"telemeter-client-77dd9bb68c-nkbxn\" (UID: \"1253f9dd-67a0-4d99-b3aa-cb889f7b1845\") " pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.757953 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.757922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" Jul 14 07:51:24.932083 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.932050 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"901fe590b8cdad7092f359357bbc31d3a03d4f5e14fe878e82bf6f1bc6c6f202"} Jul 14 07:51:24.932241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.932131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"069b266c0869473f5ebcb246cfdcc2a2a339b72d737b1543a8729e3d9e1109da"} Jul 14 07:51:24.932241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.932174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"32d01b339769434061bad089407b7cf5328951955bd5dc4fa1ebf41c9c77c54b"} Jul 14 07:51:24.937689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:24.937666 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn"] Jul 14 07:51:25.233329 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:51:25.233255 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1253f9dd_67a0_4d99_b3aa_cb889f7b1845.slice/crio-25801323b6e06d0c2e3d18d54dde784b87c8984afb829e8abd9eacce9dd2f978 WatchSource:0}: Error finding container 25801323b6e06d0c2e3d18d54dde784b87c8984afb829e8abd9eacce9dd2f978: Status 404 returned error can't find the container with id 25801323b6e06d0c2e3d18d54dde784b87c8984afb829e8abd9eacce9dd2f978 Jul 14 07:51:25.941939 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.941885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"1b652ca8550a6946563f07ec447aead778db74e3d8632092d5dfc0b1e9162620"} Jul 14 07:51:25.942383 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.941965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"4314513265e63b3dd8611e0c8eae2fa0d439a717a6266b3c433b3dbefd0367c4"} Jul 14 07:51:25.942383 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.942005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" event={"ID":"3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5","Type":"ContainerStarted","Data":"8940bccf645ac239dbab7e6963b978fb3b005779e80a71347e446016541de719"} Jul 14 07:51:25.942383 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.942117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:25.946158 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946104 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"49a4ab3ecb0d2eb8e7fc8e84188d20bae44d79349fdd528856a0df80db462085"} Jul 14 07:51:25.946288 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"94f6882b64d5045746e4adac13b4d09a72add96414915bdfabc4aa9bbad6208f"} Jul 14 07:51:25.946288 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"9405b9bb83e09feb3d033404a7b03f93bf6e86dcbe90446474c88885ba99c57d"} Jul 14 07:51:25.946288 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"86df23c72c89e80074ee5b89854f12c1f6533e424c940e48cfee5d6f29b8c460"} Jul 14 07:51:25.946448 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"abf8e55baf20ca7218278190fb5662a25b0198daeb600af504df3e5c67f43e22"} Jul 14 07:51:25.946448 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.946343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9c3e7aad-1105-4bf8-b5e4-904850e4e116","Type":"ContainerStarted","Data":"ea8889e1bdae7cd333a0baf383f72cade7459bf2607daf308c7a1ea976cc6faa"} Jul 14 07:51:25.947575 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.947555 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" event={"ID":"1253f9dd-67a0-4d99-b3aa-cb889f7b1845","Type":"ContainerStarted","Data":"25801323b6e06d0c2e3d18d54dde784b87c8984afb829e8abd9eacce9dd2f978"} Jul 14 07:51:25.963570 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.963497 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" podStartSLOduration=1.795854014 podStartE2EDuration="4.963478312s" totalImagesPullingTime="3.167624298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:25.962297443 +0000 UTC m=+78.990443007" watchObservedRunningTime="2026-07-14 07:51:25.963478312 +0000 UTC m=+78.991623840" Jul 14 07:51:25.990461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:25.990398 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.273829057 podStartE2EDuration="5.990382277s" totalImagesPullingTime="3.693344524s" totalInitContainerRuntime="23.208696ms" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:25.989196354 +0000 UTC m=+79.017341880" watchObservedRunningTime="2026-07-14 07:51:25.990382277 +0000 UTC m=+79.018527802" Jul 14 07:51:26.958620 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:26.958581 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" event={"ID":"1253f9dd-67a0-4d99-b3aa-cb889f7b1845","Type":"ContainerStarted","Data":"95af1877b509dcd3db08ae400d4dc83054937d221f42ab30ae09e53f0839de65"} Jul 14 07:51:27.964249 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:27.964212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" event={"ID":"1253f9dd-67a0-4d99-b3aa-cb889f7b1845","Type":"ContainerStarted","Data":"8f1d68b1375e559cad61164bf1c2ca56f26c4e88b34d5fdb3067f0ecd6e13439"} Jul 14 07:51:27.964607 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:27.964274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" event={"ID":"1253f9dd-67a0-4d99-b3aa-cb889f7b1845","Type":"ContainerStarted","Data":"bcc8553391ecaa26af973d03974a5c56ba8fde4de4d2428f6762fd587393d688"} Jul 14 07:51:27.985906 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:27.985861 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77dd9bb68c-nkbxn" podStartSLOduration=2.342680831 podStartE2EDuration="3.985842715s" totalImagesPullingTime="1.643161884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:51:27.984954022 +0000 UTC m=+81.013099550" watchObservedRunningTime="2026-07-14 07:51:27.985842715 +0000 UTC m=+81.013988242" Jul 14 07:51:31.965024 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:31.964996 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7857f8d8d4-dpwrn" Jul 14 07:51:49.705120 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:49.705082 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zbpfm_3005873c-318a-4776-b0eb-421555f8d20a/serve-healthcheck-canary/0.log" Jul 14 07:51:49.897327 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:51:49.897291 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z56lr" Jul 14 07:53:36.083643 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.083608 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8"] Jul 14 07:53:36.085977 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.085959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.088225 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.088205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 07:53:36.089042 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.089015 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 07:53:36.089042 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.089029 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qmmpl\"" Jul 14 07:53:36.095058 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.095038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8"] Jul 14 07:53:36.132944 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.132898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmwq\" (UniqueName: \"kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.132944 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.132945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.133161 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.133018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.233544 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.233505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmwq\" (UniqueName: \"kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.233713 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.233550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.233713 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.233603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.234008 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.233986 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.234054 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.234008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.241742 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.241713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmwq\" (UniqueName: \"kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.395191 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.395095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:36.519467 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:36.519444 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8"] Jul 14 07:53:36.522161 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:53:36.522130 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1eb469_dcb8_4fe9_a8ef_6b6a795ad4c3.slice/crio-986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9 WatchSource:0}: Error finding container 986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9: Status 404 returned error can't find the container with id 986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9 Jul 14 07:53:37.429744 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:37.429705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" event={"ID":"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3","Type":"ContainerStarted","Data":"986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9"} Jul 14 07:53:43.455904 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:43.455820 2556 generic.go:356] "Generic (PLEG): container finished" podID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerID="46beb6fdc8fcf7636604844d18ed0fefa967a86c5f559074904e165e245fc007" exitCode=0 Jul 14 07:53:43.456239 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:43.455895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" event={"ID":"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3","Type":"ContainerDied","Data":"46beb6fdc8fcf7636604844d18ed0fefa967a86c5f559074904e165e245fc007"} Jul 14 07:53:45.466278 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:45.466194 2556 generic.go:356] "Generic (PLEG): container finished" podID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerID="02e651da49956bbca6da7857847783649932675e009acb7420b703c3d64027ac" exitCode=0 Jul 14 07:53:45.466278 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:45.466248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" event={"ID":"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3","Type":"ContainerDied","Data":"02e651da49956bbca6da7857847783649932675e009acb7420b703c3d64027ac"} Jul 14 07:53:53.501462 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:53.501373 2556 generic.go:356] "Generic (PLEG): container finished" podID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerID="c0416822f39cdf3a1177d5a3cbffcb70147f80b5334e5390658b462d68f51260" exitCode=0 Jul 14 07:53:53.501462 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:53.501447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" event={"ID":"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3","Type":"ContainerDied","Data":"c0416822f39cdf3a1177d5a3cbffcb70147f80b5334e5390658b462d68f51260"} Jul 14 07:53:54.638768 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.638736 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:54.790091 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.790062 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcmwq\" (UniqueName: \"kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq\") pod \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " Jul 14 07:53:54.790281 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.790106 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle\") pod \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " Jul 14 07:53:54.790281 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.790180 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util\") pod \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\" (UID: \"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3\") " Jul 14 07:53:54.790746 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.790721 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle" (OuterVolumeSpecName: "bundle") pod "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" (UID: "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:53:54.792233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.792210 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq" (OuterVolumeSpecName: "kube-api-access-vcmwq") pod "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" (UID: "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3"). InnerVolumeSpecName "kube-api-access-vcmwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:53:54.797508 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.797482 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util" (OuterVolumeSpecName: "util") pod "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" (UID: "3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:53:54.890969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.890934 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcmwq\" (UniqueName: \"kubernetes.io/projected/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-kube-api-access-vcmwq\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:53:54.890969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.890963 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:53:54.890969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:54.890973 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:53:55.510488 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:55.510468 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" Jul 14 07:53:55.510488 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:55.510467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hmxc8" event={"ID":"3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3","Type":"ContainerDied","Data":"986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9"} Jul 14 07:53:55.510650 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:55.510517 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="986a59dc7cd35895a163b91539d426e690b5423aaad35a6ff8af1547235c84f9" Jul 14 07:53:58.995058 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995025 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb"] Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995310 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="util" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995321 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="util" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995334 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="pull" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995339 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="pull" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995350 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="extract" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995356 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="extract" Jul 14 07:53:58.995425 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.995398 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e1eb469-dcb8-4fe9-a8ef-6b6a795ad4c3" containerName="extract" Jul 14 07:53:58.998157 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:58.998142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.003036 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.003014 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 07:53:59.005767 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.005749 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 07:53:59.006579 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.006559 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6lk2x\"" Jul 14 07:53:59.017353 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.017331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb"] Jul 14 07:53:59.122894 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.122856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6hd6\" (UniqueName: \"kubernetes.io/projected/1733fe02-2cb9-49d7-807c-ce5427c8b670-kube-api-access-r6hd6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.123070 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.122910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1733fe02-2cb9-49d7-807c-ce5427c8b670-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.224121 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.224086 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6hd6\" (UniqueName: \"kubernetes.io/projected/1733fe02-2cb9-49d7-807c-ce5427c8b670-kube-api-access-r6hd6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.224243 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.224134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1733fe02-2cb9-49d7-807c-ce5427c8b670-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.224487 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.224471 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1733fe02-2cb9-49d7-807c-ce5427c8b670-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.234554 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.234524 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6hd6\" (UniqueName: \"kubernetes.io/projected/1733fe02-2cb9-49d7-807c-ce5427c8b670-kube-api-access-r6hd6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dfvdb\" (UID: \"1733fe02-2cb9-49d7-807c-ce5427c8b670\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.306517 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.306481 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" Jul 14 07:53:59.447232 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.447209 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb"] Jul 14 07:53:59.450175 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:53:59.450141 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1733fe02_2cb9_49d7_807c_ce5427c8b670.slice/crio-5b61462676e01209cf4d4b8bc9466b070776355468f0f357c97c6a06373d3fd1 WatchSource:0}: Error finding container 5b61462676e01209cf4d4b8bc9466b070776355468f0f357c97c6a06373d3fd1: Status 404 returned error can't find the container with id 5b61462676e01209cf4d4b8bc9466b070776355468f0f357c97c6a06373d3fd1 Jul 14 07:53:59.527209 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:53:59.527175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" event={"ID":"1733fe02-2cb9-49d7-807c-ce5427c8b670","Type":"ContainerStarted","Data":"5b61462676e01209cf4d4b8bc9466b070776355468f0f357c97c6a06373d3fd1"} Jul 14 07:54:01.538030 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:01.537989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" event={"ID":"1733fe02-2cb9-49d7-807c-ce5427c8b670","Type":"ContainerStarted","Data":"4564ef3d73b97cfb8048132fc8c98b942eb674d11590b3f18e93bed954cf610e"} Jul 14 07:54:01.567961 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:01.567908 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dfvdb" podStartSLOduration=2.183555547 podStartE2EDuration="3.567891635s" totalImagesPullingTime="1.384336088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:01.566672292 +0000 UTC m=+234.594817832" watchObservedRunningTime="2026-07-14 07:54:01.567891635 +0000 UTC m=+234.596037161" Jul 14 07:54:02.932963 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.932926 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5"] Jul 14 07:54:02.936551 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.936535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:02.939026 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.939007 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 07:54:02.939117 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.939036 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 07:54:02.939829 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.939799 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qmmpl\"" Jul 14 07:54:02.943365 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:02.943336 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5"] Jul 14 07:54:03.058412 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.058373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.058588 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.058477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xlkw\" (UniqueName: \"kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.058588 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.058497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.159391 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.159356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xlkw\" (UniqueName: \"kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.159391 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.159397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.159600 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.159423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.159880 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.159859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.159919 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.159874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.168476 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.168453 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xlkw\" (UniqueName: \"kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.246929 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.246823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:03.379447 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.379416 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5"] Jul 14 07:54:03.382456 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:03.382431 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae28226_109c_49ff_ab8e_3aa20f58ed6c.slice/crio-5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3 WatchSource:0}: Error finding container 5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3: Status 404 returned error can't find the container with id 5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3 Jul 14 07:54:03.484861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.484822 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mxjpr"] Jul 14 07:54:03.488154 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.488132 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.490708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.490685 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 07:54:03.490827 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.490739 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 07:54:03.490875 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.490861 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gfcwq\"" Jul 14 07:54:03.495149 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.495124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mxjpr"] Jul 14 07:54:03.547669 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.547637 2556 generic.go:356] "Generic (PLEG): container finished" podID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerID="dbf8a6c96c0d891f36a809fdc5e86fe1ce36ebfbbdd3fc00a045464ab56b2e95" exitCode=0 Jul 14 07:54:03.547833 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.547723 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" event={"ID":"9ae28226-109c-49ff-ab8e-3aa20f58ed6c","Type":"ContainerDied","Data":"dbf8a6c96c0d891f36a809fdc5e86fe1ce36ebfbbdd3fc00a045464ab56b2e95"} Jul 14 07:54:03.547833 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.547780 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" event={"ID":"9ae28226-109c-49ff-ab8e-3aa20f58ed6c","Type":"ContainerStarted","Data":"5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3"} Jul 14 07:54:03.563357 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.563308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcfd9\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-kube-api-access-pcfd9\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.563500 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.563364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.664463 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.664415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcfd9\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-kube-api-access-pcfd9\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.664463 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.664456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.673003 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.672979 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.673119 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.673047 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcfd9\" (UniqueName: \"kubernetes.io/projected/8c04e579-59db-42fc-b43f-79473aeb8198-kube-api-access-pcfd9\") pod \"cert-manager-webhook-6486ffd997-mxjpr\" (UID: \"8c04e579-59db-42fc-b43f-79473aeb8198\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.842764 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.842671 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:03.970284 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:03.970090 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mxjpr"] Jul 14 07:54:03.972875 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:03.972842 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c04e579_59db_42fc_b43f_79473aeb8198.slice/crio-6ee8d44c5ae45e76ba7058157a0afb068d32656b03095a124c59a4b15d07923a WatchSource:0}: Error finding container 6ee8d44c5ae45e76ba7058157a0afb068d32656b03095a124c59a4b15d07923a: Status 404 returned error can't find the container with id 6ee8d44c5ae45e76ba7058157a0afb068d32656b03095a124c59a4b15d07923a Jul 14 07:54:04.554069 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:04.554032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" event={"ID":"8c04e579-59db-42fc-b43f-79473aeb8198","Type":"ContainerStarted","Data":"6ee8d44c5ae45e76ba7058157a0afb068d32656b03095a124c59a4b15d07923a"} Jul 14 07:54:05.225059 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.225025 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64h7c"] Jul 14 07:54:05.228493 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.228472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.231091 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.231069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rc6d7\"" Jul 14 07:54:05.240270 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.240239 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64h7c"] Jul 14 07:54:05.322442 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:54:05.322376 2556 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage1237558545/2\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260714%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260714T075405Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=967376d05032362b63151788eb4b3d189b14a2e9ce0c55edf507e0737e7cd243®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784016545~hmac=df0b0b6444dbef2a13b21b8ad9d8db827b8701b4c8f0fb6789209e6a60db79bd\": EOF); artifact err: provided artifact is a container image" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06" Jul 14 07:54:05.322622 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:54:05.322532 2556 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5_openshift-marketplace(9ae28226-109c-49ff-ab8e-3aa20f58ed6c): ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \"/var/tmp/container_images_storage1237558545/2\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260714%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260714T075405Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=967376d05032362b63151788eb4b3d189b14a2e9ce0c55edf507e0737e7cd243®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784016545~hmac=df0b0b6444dbef2a13b21b8ad9d8db827b8701b4c8f0fb6789209e6a60db79bd\": EOF); artifact err: provided artifact is a container image" logger="UnhandledError" Jul 14 07:54:05.322622 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:54:05.322589 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage1237558545/2\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260714%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260714T075405Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=967376d05032362b63151788eb4b3d189b14a2e9ce0c55edf507e0737e7cd243®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784016545~hmac=df0b0b6444dbef2a13b21b8ad9d8db827b8701b4c8f0fb6789209e6a60db79bd\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" Jul 14 07:54:05.381288 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.381250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss82d\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-kube-api-access-ss82d\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.381441 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.381302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.482181 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.482093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss82d\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-kube-api-access-ss82d\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.482181 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.482156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.491846 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.491798 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.492130 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.492090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss82d\" (UniqueName: \"kubernetes.io/projected/cfd99d69-6637-4634-9e1a-9abeb82e8cfe-kube-api-access-ss82d\") pod \"cert-manager-cainjector-559cdd8c87-64h7c\" (UID: \"cfd99d69-6637-4634-9e1a-9abeb82e8cfe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.539867 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.539812 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" Jul 14 07:54:05.568461 ip-10-0-128-86 kubenswrapper[2556]: E0714 07:54:05.568416 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: writing blob: storing blob to file \\\"/var/tmp/container_images_storage1237558545/2\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/8e/8ed306a9eb2cdc7b5db57788b7a70b8d6dae2ecfc602b7662ac4cebb197a1841?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260714%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260714T075405Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=967376d05032362b63151788eb4b3d189b14a2e9ce0c55edf507e0737e7cd243®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=leader-worker-set----lws-operator-bundle&akamai_signature=exp=1784016545~hmac=df0b0b6444dbef2a13b21b8ad9d8db827b8701b4c8f0fb6789209e6a60db79bd\\\": EOF); artifact err: provided artifact is a container image\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" Jul 14 07:54:05.685603 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:05.685577 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-64h7c"] Jul 14 07:54:06.483026 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:06.482984 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfd99d69_6637_4634_9e1a_9abeb82e8cfe.slice/crio-ce49404e72933918361aec3965b3bd5b0250d930b9b527cae4f3e03ad920ec15 WatchSource:0}: Error finding container ce49404e72933918361aec3965b3bd5b0250d930b9b527cae4f3e03ad920ec15: Status 404 returned error can't find the container with id ce49404e72933918361aec3965b3bd5b0250d930b9b527cae4f3e03ad920ec15 Jul 14 07:54:06.573744 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:06.573711 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" event={"ID":"cfd99d69-6637-4634-9e1a-9abeb82e8cfe","Type":"ContainerStarted","Data":"ce49404e72933918361aec3965b3bd5b0250d930b9b527cae4f3e03ad920ec15"} Jul 14 07:54:07.578960 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:07.578922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" event={"ID":"8c04e579-59db-42fc-b43f-79473aeb8198","Type":"ContainerStarted","Data":"3a15c3bf8af02c212873a7894dd8d8912171a56de2c747084fc25771696c6a29"} Jul 14 07:54:07.579454 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:07.578991 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:07.580380 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:07.580356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" event={"ID":"cfd99d69-6637-4634-9e1a-9abeb82e8cfe","Type":"ContainerStarted","Data":"84d99d45e321cf4833ee9086d0740245688dfc9120d87090fb18161d566e7402"} Jul 14 07:54:07.595703 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:07.595659 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" podStartSLOduration=2.029624432 podStartE2EDuration="4.595644515s" totalImagesPullingTime="2.566020083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:07.594426486 +0000 UTC m=+240.622572013" watchObservedRunningTime="2026-07-14 07:54:07.595644515 +0000 UTC m=+240.623790042" Jul 14 07:54:07.614938 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:07.614892 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-64h7c" podStartSLOduration=2.286462981 podStartE2EDuration="2.614876012s" totalImagesPullingTime="328.413031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:07.613973473 +0000 UTC m=+240.642119005" watchObservedRunningTime="2026-07-14 07:54:07.614876012 +0000 UTC m=+240.643021539" Jul 14 07:54:13.586838 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:13.586785 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mxjpr" Jul 14 07:54:14.915108 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:14.915076 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wkj97"] Jul 14 07:54:14.963959 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:14.963927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wkj97"] Jul 14 07:54:14.964108 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:14.964021 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:14.966527 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:14.966506 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-m4zbn\"" Jul 14 07:54:15.062431 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.062398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-bound-sa-token\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.062596 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.062458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tkct\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-kube-api-access-4tkct\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.163948 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.163910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-bound-sa-token\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.164099 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.163960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tkct\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-kube-api-access-4tkct\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.173034 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.172975 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-bound-sa-token\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.173139 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.173067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tkct\" (UniqueName: \"kubernetes.io/projected/81bc91ac-b6ea-4f4e-bbb8-255dd84bba87-kube-api-access-4tkct\") pod \"cert-manager-55b4d954d5-wkj97\" (UID: \"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87\") " pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.273062 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.273027 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wkj97" Jul 14 07:54:15.413060 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.413039 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wkj97"] Jul 14 07:54:15.415668 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:15.415646 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81bc91ac_b6ea_4f4e_bbb8_255dd84bba87.slice/crio-7658dd063a9817afcffc9f147984274d0af9e8ccd43b8b2519931690ed65df5e WatchSource:0}: Error finding container 7658dd063a9817afcffc9f147984274d0af9e8ccd43b8b2519931690ed65df5e: Status 404 returned error can't find the container with id 7658dd063a9817afcffc9f147984274d0af9e8ccd43b8b2519931690ed65df5e Jul 14 07:54:15.613727 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.613698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wkj97" event={"ID":"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87","Type":"ContainerStarted","Data":"b1e2999cb1343a7573617cb59af3141ec4d0645fdf1c1478fe41f1900e0e890b"} Jul 14 07:54:15.613727 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.613736 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wkj97" event={"ID":"81bc91ac-b6ea-4f4e-bbb8-255dd84bba87","Type":"ContainerStarted","Data":"7658dd063a9817afcffc9f147984274d0af9e8ccd43b8b2519931690ed65df5e"} Jul 14 07:54:15.631960 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:15.631911 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wkj97" podStartSLOduration=1.631896676 podStartE2EDuration="1.631896676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:15.630853198 +0000 UTC m=+248.658998726" watchObservedRunningTime="2026-07-14 07:54:15.631896676 +0000 UTC m=+248.660042202" Jul 14 07:54:22.649386 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:22.649305 2556 generic.go:356] "Generic (PLEG): container finished" podID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerID="ba9d812a2b88f86e9183f7f6f7c84fd2853e02cbd70aecf60c4fb808528627ca" exitCode=0 Jul 14 07:54:22.649792 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:22.649412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" event={"ID":"9ae28226-109c-49ff-ab8e-3aa20f58ed6c","Type":"ContainerDied","Data":"ba9d812a2b88f86e9183f7f6f7c84fd2853e02cbd70aecf60c4fb808528627ca"} Jul 14 07:54:23.655056 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:23.655023 2556 generic.go:356] "Generic (PLEG): container finished" podID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerID="9cc2a168cd40de338a70adec119863881b2ce1e81639c6b951dfe3016555d312" exitCode=0 Jul 14 07:54:23.655522 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:23.655091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" event={"ID":"9ae28226-109c-49ff-ab8e-3aa20f58ed6c","Type":"ContainerDied","Data":"9cc2a168cd40de338a70adec119863881b2ce1e81639c6b951dfe3016555d312"} Jul 14 07:54:24.793632 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.793603 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:24.841109 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.841074 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xlkw\" (UniqueName: \"kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw\") pod \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " Jul 14 07:54:24.841268 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.841136 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util\") pod \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " Jul 14 07:54:24.841308 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.841276 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle\") pod \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\" (UID: \"9ae28226-109c-49ff-ab8e-3aa20f58ed6c\") " Jul 14 07:54:24.841626 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.841598 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle" (OuterVolumeSpecName: "bundle") pod "9ae28226-109c-49ff-ab8e-3aa20f58ed6c" (UID: "9ae28226-109c-49ff-ab8e-3aa20f58ed6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:54:24.843266 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.843235 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw" (OuterVolumeSpecName: "kube-api-access-5xlkw") pod "9ae28226-109c-49ff-ab8e-3aa20f58ed6c" (UID: "9ae28226-109c-49ff-ab8e-3aa20f58ed6c"). InnerVolumeSpecName "kube-api-access-5xlkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:54:24.847840 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.847815 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util" (OuterVolumeSpecName: "util") pod "9ae28226-109c-49ff-ab8e-3aa20f58ed6c" (UID: "9ae28226-109c-49ff-ab8e-3aa20f58ed6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:54:24.942738 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.942655 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:24.942738 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.942682 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:24.942738 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:24.942692 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xlkw\" (UniqueName: \"kubernetes.io/projected/9ae28226-109c-49ff-ab8e-3aa20f58ed6c-kube-api-access-5xlkw\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:25.665594 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:25.665564 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" Jul 14 07:54:25.665762 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:25.665594 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxhgz5" event={"ID":"9ae28226-109c-49ff-ab8e-3aa20f58ed6c","Type":"ContainerDied","Data":"5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3"} Jul 14 07:54:25.665762 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:25.665639 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5713f0a81a38e965920ed3235806de76669e5bd313634d3f88ca06209027dbf3" Jul 14 07:54:34.607074 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607041 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w"] Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607506 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="util" Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607525 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="util" Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607545 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="extract" Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607553 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="extract" Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607581 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="pull" Jul 14 07:54:34.607638 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607589 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="pull" Jul 14 07:54:34.607982 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.607660 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae28226-109c-49ff-ab8e-3aa20f58ed6c" containerName="extract" Jul 14 07:54:34.609841 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.609820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.612204 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.612176 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 07:54:34.612204 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.612195 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qmmpl\"" Jul 14 07:54:34.613104 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.613088 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 07:54:34.618428 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.618402 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w"] Jul 14 07:54:34.725856 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.725822 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.726030 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.725895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj859\" (UniqueName: \"kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.726030 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.725939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.826485 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.826454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.826683 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.826507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj859\" (UniqueName: \"kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.826683 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.826537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.826877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.826854 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.826971 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.826882 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.835973 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.835948 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj859\" (UniqueName: \"kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:34.920012 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:34.919920 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:35.064980 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:35.064934 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w"] Jul 14 07:54:35.067069 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:35.067042 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac7c160_4058_4394_961e_45ff9ded3ede.slice/crio-1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d WatchSource:0}: Error finding container 1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d: Status 404 returned error can't find the container with id 1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d Jul 14 07:54:35.707628 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:35.707591 2556 generic.go:356] "Generic (PLEG): container finished" podID="fac7c160-4058-4394-961e-45ff9ded3ede" containerID="45fe22d09d50ae611b1db4c6eb7e4811d57eaff0981c21c76ff99f65f7859e2d" exitCode=0 Jul 14 07:54:35.708018 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:35.707653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" event={"ID":"fac7c160-4058-4394-961e-45ff9ded3ede","Type":"ContainerDied","Data":"45fe22d09d50ae611b1db4c6eb7e4811d57eaff0981c21c76ff99f65f7859e2d"} Jul 14 07:54:35.708018 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:35.707696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" event={"ID":"fac7c160-4058-4394-961e-45ff9ded3ede","Type":"ContainerStarted","Data":"1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d"} Jul 14 07:54:36.714580 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:36.714490 2556 generic.go:356] "Generic (PLEG): container finished" podID="fac7c160-4058-4394-961e-45ff9ded3ede" containerID="1732c5a64bfd619965382903f79dd3e519c4e0e3c8dd279dd328e82ca5c7853f" exitCode=0 Jul 14 07:54:36.714580 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:36.714566 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" event={"ID":"fac7c160-4058-4394-961e-45ff9ded3ede","Type":"ContainerDied","Data":"1732c5a64bfd619965382903f79dd3e519c4e0e3c8dd279dd328e82ca5c7853f"} Jul 14 07:54:37.720608 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:37.720570 2556 generic.go:356] "Generic (PLEG): container finished" podID="fac7c160-4058-4394-961e-45ff9ded3ede" containerID="a033a4d8b8ed29bf7b06ee37db358bba85b9e404d805eae5c792700125742d18" exitCode=0 Jul 14 07:54:37.721005 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:37.720649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" event={"ID":"fac7c160-4058-4394-961e-45ff9ded3ede","Type":"ContainerDied","Data":"a033a4d8b8ed29bf7b06ee37db358bba85b9e404d805eae5c792700125742d18"} Jul 14 07:54:38.847264 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.847239 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:38.960987 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.960951 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj859\" (UniqueName: \"kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859\") pod \"fac7c160-4058-4394-961e-45ff9ded3ede\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " Jul 14 07:54:38.961154 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.961023 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle\") pod \"fac7c160-4058-4394-961e-45ff9ded3ede\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " Jul 14 07:54:38.961154 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.961045 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util\") pod \"fac7c160-4058-4394-961e-45ff9ded3ede\" (UID: \"fac7c160-4058-4394-961e-45ff9ded3ede\") " Jul 14 07:54:38.961962 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.961926 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle" (OuterVolumeSpecName: "bundle") pod "fac7c160-4058-4394-961e-45ff9ded3ede" (UID: "fac7c160-4058-4394-961e-45ff9ded3ede"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:54:38.963381 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.963357 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859" (OuterVolumeSpecName: "kube-api-access-nj859") pod "fac7c160-4058-4394-961e-45ff9ded3ede" (UID: "fac7c160-4058-4394-961e-45ff9ded3ede"). InnerVolumeSpecName "kube-api-access-nj859". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:54:38.967053 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:38.967035 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util" (OuterVolumeSpecName: "util") pod "fac7c160-4058-4394-961e-45ff9ded3ede" (UID: "fac7c160-4058-4394-961e-45ff9ded3ede"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:54:39.061972 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.061937 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:39.061972 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.061966 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fac7c160-4058-4394-961e-45ff9ded3ede-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:39.061972 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.061976 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj859\" (UniqueName: \"kubernetes.io/projected/fac7c160-4058-4394-961e-45ff9ded3ede-kube-api-access-nj859\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:54:39.731926 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.731894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" event={"ID":"fac7c160-4058-4394-961e-45ff9ded3ede","Type":"ContainerDied","Data":"1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d"} Jul 14 07:54:39.731926 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.731927 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af66f6w" Jul 14 07:54:39.732124 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:39.731938 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d1ff7b7c85050a3d132f36a288ff577ac32038b36861c3d5ce9c32e2f300b5d" Jul 14 07:54:45.331022 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.330993 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz"] Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331277 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="util" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331287 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="util" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331299 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="pull" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331305 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="pull" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331325 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="extract" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331330 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="extract" Jul 14 07:54:45.331461 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.331381 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac7c160-4058-4394-961e-45ff9ded3ede" containerName="extract" Jul 14 07:54:45.333327 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.333311 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.336979 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.336943 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 07:54:45.336979 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.336972 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 07:54:45.337173 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.337015 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 07:54:45.337173 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.337044 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 07:54:45.337173 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.336981 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5q6c\"" Jul 14 07:54:45.337173 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.336999 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 07:54:45.343044 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.343019 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz"] Jul 14 07:54:45.415868 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.415835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-metrics-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.415868 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.415871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gvn\" (UniqueName: \"kubernetes.io/projected/b0583099-d9b5-45e3-a5fd-259b2f5e4784-kube-api-access-v6gvn\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.416098 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.415911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.416098 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.415986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0583099-d9b5-45e3-a5fd-259b2f5e4784-manager-config\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.516773 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.516732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-metrics-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.516773 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.516773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gvn\" (UniqueName: \"kubernetes.io/projected/b0583099-d9b5-45e3-a5fd-259b2f5e4784-kube-api-access-v6gvn\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.517043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.516853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.517043 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.516926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0583099-d9b5-45e3-a5fd-259b2f5e4784-manager-config\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.517563 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.517543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0583099-d9b5-45e3-a5fd-259b2f5e4784-manager-config\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.519298 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.519276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-metrics-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.519464 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.519443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0583099-d9b5-45e3-a5fd-259b2f5e4784-cert\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.531585 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.531558 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gvn\" (UniqueName: \"kubernetes.io/projected/b0583099-d9b5-45e3-a5fd-259b2f5e4784-kube-api-access-v6gvn\") pod \"lws-controller-manager-67649569dd-m8zvz\" (UID: \"b0583099-d9b5-45e3-a5fd-259b2f5e4784\") " pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.648020 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.647931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:45.781322 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:45.781295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz"] Jul 14 07:54:45.783979 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:45.783955 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0583099_d9b5_45e3_a5fd_259b2f5e4784.slice/crio-7c4779292149759b972af642c76b9806d6c6795ed6e6d07aeb458deca904a9f8 WatchSource:0}: Error finding container 7c4779292149759b972af642c76b9806d6c6795ed6e6d07aeb458deca904a9f8: Status 404 returned error can't find the container with id 7c4779292149759b972af642c76b9806d6c6795ed6e6d07aeb458deca904a9f8 Jul 14 07:54:46.761708 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:46.761670 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" event={"ID":"b0583099-d9b5-45e3-a5fd-259b2f5e4784","Type":"ContainerStarted","Data":"7c4779292149759b972af642c76b9806d6c6795ed6e6d07aeb458deca904a9f8"} Jul 14 07:54:50.781139 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:50.781099 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" event={"ID":"b0583099-d9b5-45e3-a5fd-259b2f5e4784","Type":"ContainerStarted","Data":"cc91e57fbe9d53f8b8e5524b6ffd168198b78c914638541ac2ddd081b69b026f"} Jul 14 07:54:50.781543 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:50.781226 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:54:50.815705 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:50.815639 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" podStartSLOduration=1.4617632760000001 podStartE2EDuration="5.815618788s" totalImagesPullingTime="4.353855512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:50.815037992 +0000 UTC m=+283.843183542" watchObservedRunningTime="2026-07-14 07:54:50.815618788 +0000 UTC m=+283.843764321" Jul 14 07:54:51.728028 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.727991 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf"] Jul 14 07:54:51.730316 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.730299 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.733191 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.733167 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 07:54:51.733191 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.733180 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 07:54:51.733434 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.733422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xkkrl\"" Jul 14 07:54:51.733969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.733952 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 07:54:51.733969 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.733964 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 07:54:51.755269 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.755239 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf"] Jul 14 07:54:51.870347 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.870310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl9w8\" (UniqueName: \"kubernetes.io/projected/a6397958-12e3-48da-9119-73ce39d65bad-kube-api-access-kl9w8\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.870861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.870351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.870861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.870421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.870861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.870445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.870861 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.870488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.971587 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.971552 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl9w8\" (UniqueName: \"kubernetes.io/projected/a6397958-12e3-48da-9119-73ce39d65bad-kube-api-access-kl9w8\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.971587 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.971594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.971820 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.971630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.971820 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.971652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.971820 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.971698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.972104 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.972075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-manifests\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.973883 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.973861 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6397958-12e3-48da-9119-73ce39d65bad-tmp\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.974102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.974084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.974170 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.974113 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6397958-12e3-48da-9119-73ce39d65bad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:51.982604 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:51.982535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl9w8\" (UniqueName: \"kubernetes.io/projected/a6397958-12e3-48da-9119-73ce39d65bad-kube-api-access-kl9w8\") pod \"opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf\" (UID: \"a6397958-12e3-48da-9119-73ce39d65bad\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:52.040989 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:52.040958 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:52.183046 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:52.182920 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf"] Jul 14 07:54:52.185344 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:54:52.185317 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6397958_12e3_48da_9119_73ce39d65bad.slice/crio-6818e99a6a2a140399663c1b3d8229e029457fb2656e812d894ef90954268cd2 WatchSource:0}: Error finding container 6818e99a6a2a140399663c1b3d8229e029457fb2656e812d894ef90954268cd2: Status 404 returned error can't find the container with id 6818e99a6a2a140399663c1b3d8229e029457fb2656e812d894ef90954268cd2 Jul 14 07:54:52.794080 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:52.794037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" event={"ID":"a6397958-12e3-48da-9119-73ce39d65bad","Type":"ContainerStarted","Data":"6818e99a6a2a140399663c1b3d8229e029457fb2656e812d894ef90954268cd2"} Jul 14 07:54:55.812542 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:55.812507 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" event={"ID":"a6397958-12e3-48da-9119-73ce39d65bad","Type":"ContainerStarted","Data":"124645b26b2e8ddcfeda92c10304b3c405f1d42a68ee4a54dda48bcb68d3fcb6"} Jul 14 07:54:56.818346 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:56.818311 2556 generic.go:356] "Generic (PLEG): container finished" podID="a6397958-12e3-48da-9119-73ce39d65bad" containerID="124645b26b2e8ddcfeda92c10304b3c405f1d42a68ee4a54dda48bcb68d3fcb6" exitCode=0 Jul 14 07:54:56.818779 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:56.818398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" event={"ID":"a6397958-12e3-48da-9119-73ce39d65bad","Type":"ContainerDied","Data":"124645b26b2e8ddcfeda92c10304b3c405f1d42a68ee4a54dda48bcb68d3fcb6"} Jul 14 07:54:57.824519 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:57.824484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" event={"ID":"a6397958-12e3-48da-9119-73ce39d65bad","Type":"ContainerStarted","Data":"48bb145efca16ef42b69676d4ff8962829ede567f6c0cd6874f394b54c12d613"} Jul 14 07:54:57.824936 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:57.824604 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:54:57.846188 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:54:57.846133 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" podStartSLOduration=2.568958685 podStartE2EDuration="6.846119851s" totalImagesPullingTime="3.265341469s" totalInitContainerRuntime="1.011819697s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:54:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:54:57.843650656 +0000 UTC m=+290.871796175" watchObservedRunningTime="2026-07-14 07:54:57.846119851 +0000 UTC m=+290.874265378" Jul 14 07:55:01.789102 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:01.789071 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67649569dd-m8zvz" Jul 14 07:55:07.438566 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:07.438541 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 07:55:08.831255 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:08.831221 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf" Jul 14 07:55:19.803121 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.803088 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7"] Jul 14 07:55:19.806709 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.806688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.810184 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.810164 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 07:55:19.810317 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.810280 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 07:55:19.810512 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.810494 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hh848\"" Jul 14 07:55:19.810574 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.810528 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 07:55:19.818376 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.818357 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7"] Jul 14 07:55:19.902910 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.902879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903071 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.902917 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6ac866-cd70-4f9a-a675-0049881d2e42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903071 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.902968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903146 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903146 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903104 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903208 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4qc\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-kube-api-access-pl4qc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903208 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903283 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903213 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:19.903283 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:19.903250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004053 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6ac866-cd70-4f9a-a675-0049881d2e42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4qc\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-kube-api-access-pl4qc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004241 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004503 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004503 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004503 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004716 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004694 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004818 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d6ac866-cd70-4f9a-a675-0049881d2e42-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004907 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004976 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004911 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.004976 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.004954 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.006687 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.006662 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.006869 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.006850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.012029 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.012010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.012439 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.012424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4qc\" (UniqueName: \"kubernetes.io/projected/6d6ac866-cd70-4f9a-a675-0049881d2e42-kube-api-access-pl4qc\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678fq8t7\" (UID: \"6d6ac866-cd70-4f9a-a675-0049881d2e42\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.116611 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.116518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:20.266257 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.266223 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7"] Jul 14 07:55:20.270259 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:55:20.270231 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6ac866_cd70_4f9a_a675_0049881d2e42.slice/crio-8e37a442b0e38428776ea358077dc2021952b60fcdc00ff44c3361e1b33e8781 WatchSource:0}: Error finding container 8e37a442b0e38428776ea358077dc2021952b60fcdc00ff44c3361e1b33e8781: Status 404 returned error can't find the container with id 8e37a442b0e38428776ea358077dc2021952b60fcdc00ff44c3361e1b33e8781 Jul 14 07:55:20.272311 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.272295 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 07:55:20.540782 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.540741 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm"] Jul 14 07:55:20.545269 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.545245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.547929 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.547904 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 07:55:20.548070 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.547935 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7brz4\"" Jul 14 07:55:20.548070 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.547934 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 07:55:20.548070 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.547907 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 07:55:20.556025 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.555998 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm"] Jul 14 07:55:20.610111 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610270 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610270 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90890e4e-91f4-4ded-a4c2-74bb325de4e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610270 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610270 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610402 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.610402 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.610325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7jm\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-kube-api-access-sn7jm\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711132 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711132 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711323 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90890e4e-91f4-4ded-a4c2-74bb325de4e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711552 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711675 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711675 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711675 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7jm\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-kube-api-access-sn7jm\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.711918 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.711898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.714176 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.714148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/90890e4e-91f4-4ded-a4c2-74bb325de4e2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.714176 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.714170 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.714288 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.714254 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.714336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.714318 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/90890e4e-91f4-4ded-a4c2-74bb325de4e2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.725528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.725500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.725624 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.725547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7jm\" (UniqueName: \"kubernetes.io/projected/90890e4e-91f4-4ded-a4c2-74bb325de4e2-kube-api-access-sn7jm\") pod \"istiod-openshift-gateway-94bb8fbfd-xvcqm\" (UID: \"90890e4e-91f4-4ded-a4c2-74bb325de4e2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.855108 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.855016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:20.935620 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:20.935582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" event={"ID":"6d6ac866-cd70-4f9a-a675-0049881d2e42","Type":"ContainerStarted","Data":"8e37a442b0e38428776ea358077dc2021952b60fcdc00ff44c3361e1b33e8781"} Jul 14 07:55:21.032620 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:21.032583 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm"] Jul 14 07:55:21.146580 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:55:21.146454 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90890e4e_91f4_4ded_a4c2_74bb325de4e2.slice/crio-f298c86fe25aa99759e5d81a96fd3938a3cd7442c70c0a60e26bed5019ceaa0d WatchSource:0}: Error finding container f298c86fe25aa99759e5d81a96fd3938a3cd7442c70c0a60e26bed5019ceaa0d: Status 404 returned error can't find the container with id f298c86fe25aa99759e5d81a96fd3938a3cd7442c70c0a60e26bed5019ceaa0d Jul 14 07:55:21.942930 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:21.942883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" event={"ID":"90890e4e-91f4-4ded-a4c2-74bb325de4e2","Type":"ContainerStarted","Data":"f298c86fe25aa99759e5d81a96fd3938a3cd7442c70c0a60e26bed5019ceaa0d"} Jul 14 07:55:23.825075 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.825035 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 07:55:23.825339 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.825117 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 07:55:23.825339 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.825168 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 07:55:23.826295 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.826271 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 07:55:23.826363 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.826335 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 07:55:23.958630 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.958590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" event={"ID":"6d6ac866-cd70-4f9a-a675-0049881d2e42","Type":"ContainerStarted","Data":"8de42841fd9589623150c5fed10fa740dfb3f29a326358af332c0ccc54f8e3af"} Jul 14 07:55:23.960476 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.960447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" event={"ID":"90890e4e-91f4-4ded-a4c2-74bb325de4e2","Type":"ContainerStarted","Data":"7664d020a00062a75b4b44c4a0b49dd491499ca48cbc48045e98e25801c83fd3"} Jul 14 07:55:23.960714 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.960512 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:23.982639 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:23.982588 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" podStartSLOduration=1.430234337 podStartE2EDuration="4.982569085s" totalImagesPullingTime="3.552334748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:23.980746734 +0000 UTC m=+317.008892261" watchObservedRunningTime="2026-07-14 07:55:23.982569085 +0000 UTC m=+317.010714612" Jul 14 07:55:24.003269 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:24.003210 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" podStartSLOduration=1.326323916 podStartE2EDuration="4.003192933s" totalImagesPullingTime="2.676869017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:55:24.002323052 +0000 UTC m=+317.030468580" watchObservedRunningTime="2026-07-14 07:55:24.003192933 +0000 UTC m=+317.031338463" Jul 14 07:55:24.116941 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:24.116845 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:24.118150 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:24.118115 2556 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jul 14 07:55:24.118279 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:24.118178 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" podUID="6d6ac866-cd70-4f9a-a675-0049881d2e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jul 14 07:55:24.966667 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:24.966636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xvcqm" Jul 14 07:55:25.120519 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:25.120488 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:25.969641 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:25.969610 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:55:25.970598 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:55:25.970576 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678fq8t7" Jul 14 07:56:26.871221 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.871135 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j"] Jul 14 07:56:26.874725 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.874702 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:26.877160 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.877131 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 07:56:26.877267 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.877252 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 07:56:26.877997 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.877977 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7fh6g\"" Jul 14 07:56:26.882870 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.882844 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j"] Jul 14 07:56:26.983898 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.983867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:26.984066 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.983911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:26.984066 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:26.983983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.084700 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.084667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.084899 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.084712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.084899 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.084742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.085082 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.085061 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.085146 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.085125 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.093179 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.093147 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.185239 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.185156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:27.316628 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.316600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j"] Jul 14 07:56:27.319433 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:56:27.319408 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bce5e3_3a8e_41d0_b58b_378450dd407b.slice/crio-e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62 WatchSource:0}: Error finding container e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62: Status 404 returned error can't find the container with id e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62 Jul 14 07:56:27.472031 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.471953 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w"] Jul 14 07:56:27.475209 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.475192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.483539 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.483514 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w"] Jul 14 07:56:27.588117 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.588083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9qt\" (UniqueName: \"kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.588117 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.588115 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.588368 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.588149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.689151 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.689098 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9qt\" (UniqueName: \"kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.689151 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.689155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.689414 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.689214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.689665 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.689641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.689746 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.689668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.698330 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.698306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9qt\" (UniqueName: \"kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.787977 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.787937 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:27.940049 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:27.940024 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w"] Jul 14 07:56:27.942042 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:56:27.942013 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd0394a_98f6_4123_ad14_55947e307050.slice/crio-2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195 WatchSource:0}: Error finding container 2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195: Status 404 returned error can't find the container with id 2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195 Jul 14 07:56:28.084152 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.084102 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k"] Jul 14 07:56:28.087528 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.087510 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.095239 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.095214 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k"] Jul 14 07:56:28.194076 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.194037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.194076 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.194076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4h7d\" (UniqueName: \"kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.194271 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.194183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.256754 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.256719 2556 generic.go:356] "Generic (PLEG): container finished" podID="abd0394a-98f6-4123-ad14-55947e307050" containerID="e0f0cb4794c54eba17fdbcc8720b1330c3c92688c5cab401d0a2a02fd7aba25c" exitCode=0 Jul 14 07:56:28.256940 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.256831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" event={"ID":"abd0394a-98f6-4123-ad14-55947e307050","Type":"ContainerDied","Data":"e0f0cb4794c54eba17fdbcc8720b1330c3c92688c5cab401d0a2a02fd7aba25c"} Jul 14 07:56:28.256940 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.256892 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" event={"ID":"abd0394a-98f6-4123-ad14-55947e307050","Type":"ContainerStarted","Data":"2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195"} Jul 14 07:56:28.258430 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.258411 2556 generic.go:356] "Generic (PLEG): container finished" podID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerID="83ccfde0533f10000a4ed8e1a034ca364e92e54c44577859245fd460ba8f8e98" exitCode=0 Jul 14 07:56:28.258500 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.258442 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" event={"ID":"d1bce5e3-3a8e-41d0-b58b-378450dd407b","Type":"ContainerDied","Data":"83ccfde0533f10000a4ed8e1a034ca364e92e54c44577859245fd460ba8f8e98"} Jul 14 07:56:28.258540 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.258495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" event={"ID":"d1bce5e3-3a8e-41d0-b58b-378450dd407b","Type":"ContainerStarted","Data":"e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62"} Jul 14 07:56:28.295089 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.294995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.295089 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.295054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.295304 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.295113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4h7d\" (UniqueName: \"kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.295436 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.295414 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.295500 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.295444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.315342 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.315314 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4h7d\" (UniqueName: \"kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.411233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.411189 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:28.480876 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.480849 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf"] Jul 14 07:56:28.484630 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.484614 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.493165 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.493096 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf"] Jul 14 07:56:28.547208 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.547187 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k"] Jul 14 07:56:28.549584 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:56:28.549557 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56238cd3_a37e_4255_8e2c_9296c28259f2.slice/crio-0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362 WatchSource:0}: Error finding container 0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362: Status 404 returned error can't find the container with id 0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362 Jul 14 07:56:28.597006 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.596977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbxm\" (UniqueName: \"kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.597125 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.597021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.597190 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.597140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.698193 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.698161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.698344 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.698217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbxm\" (UniqueName: \"kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.698344 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.698249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.698619 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.698594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.698689 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.698603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.707680 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.707655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbxm\" (UniqueName: \"kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.796534 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.796505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:28.925896 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:28.925864 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf"] Jul 14 07:56:28.927909 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:56:28.927881 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a24380_b39b_4b88_bb2a_0bd3cf51a99f.slice/crio-a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17 WatchSource:0}: Error finding container a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17: Status 404 returned error can't find the container with id a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17 Jul 14 07:56:29.266244 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.266218 2556 generic.go:356] "Generic (PLEG): container finished" podID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerID="46841257d41e2a16afbcc6a010a14140dc4fcb9478aa53792c9830a976e6c05c" exitCode=0 Jul 14 07:56:29.266616 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.266296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerDied","Data":"46841257d41e2a16afbcc6a010a14140dc4fcb9478aa53792c9830a976e6c05c"} Jul 14 07:56:29.266616 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.266340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerStarted","Data":"a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17"} Jul 14 07:56:29.267888 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.267861 2556 generic.go:356] "Generic (PLEG): container finished" podID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerID="ca81c94c6d373b14768d9f573228b4ab9a98f5268ca43fd4878df511d4888105" exitCode=0 Jul 14 07:56:29.268035 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.267902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerDied","Data":"ca81c94c6d373b14768d9f573228b4ab9a98f5268ca43fd4878df511d4888105"} Jul 14 07:56:29.268035 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:29.267942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerStarted","Data":"0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362"} Jul 14 07:56:30.274867 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.274830 2556 generic.go:356] "Generic (PLEG): container finished" podID="abd0394a-98f6-4123-ad14-55947e307050" containerID="30760bfee30a7788da706a1e0bba16ad0e0b03d2530535c05c887fcd3dd435dc" exitCode=0 Jul 14 07:56:30.275256 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.274940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" event={"ID":"abd0394a-98f6-4123-ad14-55947e307050","Type":"ContainerDied","Data":"30760bfee30a7788da706a1e0bba16ad0e0b03d2530535c05c887fcd3dd435dc"} Jul 14 07:56:30.277157 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.277123 2556 generic.go:356] "Generic (PLEG): container finished" podID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerID="231f420d1e07f0b3ec911a767afe1c2353168772ef35280f66c4ba55a457155f" exitCode=0 Jul 14 07:56:30.277265 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.277181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" event={"ID":"d1bce5e3-3a8e-41d0-b58b-378450dd407b","Type":"ContainerDied","Data":"231f420d1e07f0b3ec911a767afe1c2353168772ef35280f66c4ba55a457155f"} Jul 14 07:56:30.279881 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.279826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerStarted","Data":"b5c1bc1a9a4b2e055209192ecea835bdac281e82cdb4fc4508305050a96854ac"} Jul 14 07:56:30.282148 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:30.282125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerStarted","Data":"8b47cad7ccc2928bcdef02c4995d24cbf80a038c4adc564d56d9ff9ba00d1d08"} Jul 14 07:56:31.290233 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.290197 2556 generic.go:356] "Generic (PLEG): container finished" podID="abd0394a-98f6-4123-ad14-55947e307050" containerID="26dbf4d35a4855a947fea81e458441a10ba501b8433e6ee1addd372a16394910" exitCode=0 Jul 14 07:56:31.290614 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.290285 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" event={"ID":"abd0394a-98f6-4123-ad14-55947e307050","Type":"ContainerDied","Data":"26dbf4d35a4855a947fea81e458441a10ba501b8433e6ee1addd372a16394910"} Jul 14 07:56:31.292120 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.292092 2556 generic.go:356] "Generic (PLEG): container finished" podID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerID="b84b4ded49ff26e1ac65d448d493e8075530c712c1c13533c4320e571245e54b" exitCode=0 Jul 14 07:56:31.292246 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.292164 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" event={"ID":"d1bce5e3-3a8e-41d0-b58b-378450dd407b","Type":"ContainerDied","Data":"b84b4ded49ff26e1ac65d448d493e8075530c712c1c13533c4320e571245e54b"} Jul 14 07:56:31.293946 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.293925 2556 generic.go:356] "Generic (PLEG): container finished" podID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerID="b5c1bc1a9a4b2e055209192ecea835bdac281e82cdb4fc4508305050a96854ac" exitCode=0 Jul 14 07:56:31.294046 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.293953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerDied","Data":"b5c1bc1a9a4b2e055209192ecea835bdac281e82cdb4fc4508305050a96854ac"} Jul 14 07:56:31.295777 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.295754 2556 generic.go:356] "Generic (PLEG): container finished" podID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerID="8b47cad7ccc2928bcdef02c4995d24cbf80a038c4adc564d56d9ff9ba00d1d08" exitCode=0 Jul 14 07:56:31.295890 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:31.295785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerDied","Data":"8b47cad7ccc2928bcdef02c4995d24cbf80a038c4adc564d56d9ff9ba00d1d08"} Jul 14 07:56:32.309369 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.309332 2556 generic.go:356] "Generic (PLEG): container finished" podID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerID="b631cbe3eb8c1e90bca193947348db366a316a6edc03d0487b1709983e821224" exitCode=0 Jul 14 07:56:32.309867 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.309413 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerDied","Data":"b631cbe3eb8c1e90bca193947348db366a316a6edc03d0487b1709983e821224"} Jul 14 07:56:32.311390 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.311366 2556 generic.go:356] "Generic (PLEG): container finished" podID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerID="b5b0a2a6ab264109c8f8e56af97d2a83ff58e51fa684c23ff54c5140bbb66b13" exitCode=0 Jul 14 07:56:32.311492 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.311448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerDied","Data":"b5b0a2a6ab264109c8f8e56af97d2a83ff58e51fa684c23ff54c5140bbb66b13"} Jul 14 07:56:32.467845 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.467822 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:32.470345 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.470327 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:32.531148 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle\") pod \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " Jul 14 07:56:32.531148 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531154 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m9qt\" (UniqueName: \"kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt\") pod \"abd0394a-98f6-4123-ad14-55947e307050\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " Jul 14 07:56:32.531336 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531196 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle\") pod \"abd0394a-98f6-4123-ad14-55947e307050\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " Jul 14 07:56:32.531398 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531380 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util\") pod \"abd0394a-98f6-4123-ad14-55947e307050\" (UID: \"abd0394a-98f6-4123-ad14-55947e307050\") " Jul 14 07:56:32.531446 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531414 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util\") pod \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " Jul 14 07:56:32.531506 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531461 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj\") pod \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\" (UID: \"d1bce5e3-3a8e-41d0-b58b-378450dd407b\") " Jul 14 07:56:32.531960 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531921 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle" (OuterVolumeSpecName: "bundle") pod "abd0394a-98f6-4123-ad14-55947e307050" (UID: "abd0394a-98f6-4123-ad14-55947e307050"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:32.532086 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.531955 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle" (OuterVolumeSpecName: "bundle") pod "d1bce5e3-3a8e-41d0-b58b-378450dd407b" (UID: "d1bce5e3-3a8e-41d0-b58b-378450dd407b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:32.533509 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.533486 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt" (OuterVolumeSpecName: "kube-api-access-6m9qt") pod "abd0394a-98f6-4123-ad14-55947e307050" (UID: "abd0394a-98f6-4123-ad14-55947e307050"). InnerVolumeSpecName "kube-api-access-6m9qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:56:32.533609 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.533587 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj" (OuterVolumeSpecName: "kube-api-access-pwcfj") pod "d1bce5e3-3a8e-41d0-b58b-378450dd407b" (UID: "d1bce5e3-3a8e-41d0-b58b-378450dd407b"). InnerVolumeSpecName "kube-api-access-pwcfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:56:32.539605 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.539580 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util" (OuterVolumeSpecName: "util") pod "abd0394a-98f6-4123-ad14-55947e307050" (UID: "abd0394a-98f6-4123-ad14-55947e307050"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:32.623098 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.623014 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util" (OuterVolumeSpecName: "util") pod "d1bce5e3-3a8e-41d0-b58b-378450dd407b" (UID: "d1bce5e3-3a8e-41d0-b58b-378450dd407b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:32.632967 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632940 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:32.632967 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632965 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m9qt\" (UniqueName: \"kubernetes.io/projected/abd0394a-98f6-4123-ad14-55947e307050-kube-api-access-6m9qt\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:32.633110 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632976 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:32.633110 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632983 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abd0394a-98f6-4123-ad14-55947e307050-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:32.633110 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632991 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1bce5e3-3a8e-41d0-b58b-378450dd407b-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:32.633110 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:32.632998 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/d1bce5e3-3a8e-41d0-b58b-378450dd407b-kube-api-access-pwcfj\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.318635 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.318606 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" Jul 14 07:56:33.318635 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.318614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w" event={"ID":"abd0394a-98f6-4123-ad14-55947e307050","Type":"ContainerDied","Data":"2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195"} Jul 14 07:56:33.319155 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.318655 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c8483ce0ca8613f3ad241fe64db09b28a4cc2a8f94786a1ace7eac1249ea195" Jul 14 07:56:33.320520 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.320495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" event={"ID":"d1bce5e3-3a8e-41d0-b58b-378450dd407b","Type":"ContainerDied","Data":"e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62"} Jul 14 07:56:33.320644 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.320536 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3eba7dceb5fa2371e883244fbf50f6db363a40128ad167beb93e43d76997d62" Jul 14 07:56:33.320644 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.320539 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j" Jul 14 07:56:33.440686 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.440659 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:33.480095 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.480066 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:33.540799 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.540766 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util\") pod \"56238cd3-a37e-4255-8e2c-9296c28259f2\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " Jul 14 07:56:33.540957 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.540863 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4h7d\" (UniqueName: \"kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d\") pod \"56238cd3-a37e-4255-8e2c-9296c28259f2\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " Jul 14 07:56:33.540957 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.540948 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle\") pod \"56238cd3-a37e-4255-8e2c-9296c28259f2\" (UID: \"56238cd3-a37e-4255-8e2c-9296c28259f2\") " Jul 14 07:56:33.541401 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.541377 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle" (OuterVolumeSpecName: "bundle") pod "56238cd3-a37e-4255-8e2c-9296c28259f2" (UID: "56238cd3-a37e-4255-8e2c-9296c28259f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:33.542915 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.542890 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d" (OuterVolumeSpecName: "kube-api-access-x4h7d") pod "56238cd3-a37e-4255-8e2c-9296c28259f2" (UID: "56238cd3-a37e-4255-8e2c-9296c28259f2"). InnerVolumeSpecName "kube-api-access-x4h7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:56:33.545642 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.545618 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util" (OuterVolumeSpecName: "util") pod "56238cd3-a37e-4255-8e2c-9296c28259f2" (UID: "56238cd3-a37e-4255-8e2c-9296c28259f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:33.641961 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.641931 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util\") pod \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " Jul 14 07:56:33.642116 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.641994 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle\") pod \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " Jul 14 07:56:33.642116 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.642019 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnbxm\" (UniqueName: \"kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm\") pod \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\" (UID: \"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f\") " Jul 14 07:56:33.642216 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.642175 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4h7d\" (UniqueName: \"kubernetes.io/projected/56238cd3-a37e-4255-8e2c-9296c28259f2-kube-api-access-x4h7d\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.642216 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.642206 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.642216 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.642215 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56238cd3-a37e-4255-8e2c-9296c28259f2-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.642578 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.642544 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle" (OuterVolumeSpecName: "bundle") pod "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" (UID: "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:33.644190 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.644165 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm" (OuterVolumeSpecName: "kube-api-access-fnbxm") pod "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" (UID: "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f"). InnerVolumeSpecName "kube-api-access-fnbxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 07:56:33.650262 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.650237 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util" (OuterVolumeSpecName: "util") pod "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" (UID: "c6a24380-b39b-4b88-bb2a-0bd3cf51a99f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 07:56:33.743558 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.743514 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-util\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.743558 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.743553 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-bundle\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:33.743558 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:33.743563 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnbxm\" (UniqueName: \"kubernetes.io/projected/c6a24380-b39b-4b88-bb2a-0bd3cf51a99f-kube-api-access-fnbxm\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 07:56:34.327180 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.327146 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" Jul 14 07:56:34.327580 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.327152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k" event={"ID":"56238cd3-a37e-4255-8e2c-9296c28259f2","Type":"ContainerDied","Data":"0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362"} Jul 14 07:56:34.327580 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.327260 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b4deee131f69fe1d25f62de88be3042dfbe5ad9c1fc32014451d81acfd63362" Jul 14 07:56:34.328979 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.328954 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" event={"ID":"c6a24380-b39b-4b88-bb2a-0bd3cf51a99f","Type":"ContainerDied","Data":"a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17"} Jul 14 07:56:34.329118 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.328980 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf" Jul 14 07:56:34.329118 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:56:34.328997 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a10579ee5021494f066646e088bda6d8da6395771deac05801a86f5b9a565b17" Jul 14 07:57:38.676071 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676036 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676345 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676355 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676367 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676372 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676378 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676384 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676391 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676396 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676402 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676408 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676416 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676421 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="util" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676428 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676433 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676443 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676447 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676452 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676457 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676464 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676469 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676478 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676483 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="pull" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676488 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676494 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676546 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1bce5e3-3a8e-41d0-b58b-378450dd407b" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676555 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a24380-b39b-4b88-bb2a-0bd3cf51a99f" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676561 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd0394a-98f6-4123-ad14-55947e307050" containerName="extract" Jul 14 07:57:38.676577 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.676569 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="56238cd3-a37e-4255-8e2c-9296c28259f2" containerName="extract" Jul 14 07:57:38.679477 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.679461 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.681842 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.681798 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 07:57:38.682003 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.681876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7fh6g\"" Jul 14 07:57:38.682003 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.681944 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 07:57:38.682710 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.682691 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 07:57:38.689193 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.689169 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:57:38.720005 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.719976 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:57:38.799644 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.799607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99567d58-962b-49d1-a35f-03c6778dc97e-config-file\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.799839 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.799648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmhkg\" (UniqueName: \"kubernetes.io/projected/99567d58-962b-49d1-a35f-03c6778dc97e-kube-api-access-hmhkg\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.900199 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.900162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99567d58-962b-49d1-a35f-03c6778dc97e-config-file\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.900199 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.900203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmhkg\" (UniqueName: \"kubernetes.io/projected/99567d58-962b-49d1-a35f-03c6778dc97e-kube-api-access-hmhkg\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.900830 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.900787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99567d58-962b-49d1-a35f-03c6778dc97e-config-file\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.913186 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.913158 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmhkg\" (UniqueName: \"kubernetes.io/projected/99567d58-962b-49d1-a35f-03c6778dc97e-kube-api-access-hmhkg\") pod \"limitador-limitador-54d6d988d5-s5c8r\" (UID: \"99567d58-962b-49d1-a35f-03c6778dc97e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:38.991222 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:38.991126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:39.129877 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:39.129846 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:57:39.131096 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:57:39.131072 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99567d58_962b_49d1_a35f_03c6778dc97e.slice/crio-f57ebfbc4cf6f48fda3ccef177860fea200c052e2ddd18cb57af45bdace32860 WatchSource:0}: Error finding container f57ebfbc4cf6f48fda3ccef177860fea200c052e2ddd18cb57af45bdace32860: Status 404 returned error can't find the container with id f57ebfbc4cf6f48fda3ccef177860fea200c052e2ddd18cb57af45bdace32860 Jul 14 07:57:39.657385 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:39.657310 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" event={"ID":"99567d58-962b-49d1-a35f-03c6778dc97e","Type":"ContainerStarted","Data":"f57ebfbc4cf6f48fda3ccef177860fea200c052e2ddd18cb57af45bdace32860"} Jul 14 07:57:41.668507 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:41.668473 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" event={"ID":"99567d58-962b-49d1-a35f-03c6778dc97e","Type":"ContainerStarted","Data":"114b0db1401ee65f58e64b97637090cd1eb00668b333745ecae6ec88de4f8d23"} Jul 14 07:57:41.668892 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:41.668543 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:57:41.689572 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:41.689526 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" podStartSLOduration=1.311744872 podStartE2EDuration="3.689511662s" totalImagesPullingTime="2.37776679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:57:41.688225318 +0000 UTC m=+454.716370846" watchObservedRunningTime="2026-07-14 07:57:41.689511662 +0000 UTC m=+454.717657200" Jul 14 07:57:52.674767 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:57:52.674735 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s5c8r" Jul 14 07:58:51.873380 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:58:51.873348 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:59:15.099856 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:15.099759 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:59:25.574169 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:25.574129 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:59:40.570728 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.570694 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs"] Jul 14 07:59:40.573984 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.573968 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.577346 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.577322 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 07:59:40.577491 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.577375 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 07:59:40.577491 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.577384 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpldq\"" Jul 14 07:59:40.577491 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.577389 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 14 07:59:40.584915 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.584891 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs"] Jul 14 07:59:40.657920 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.657881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.657920 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.657919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/20bd8fae-18fd-4ef3-8b69-f8ef57832424-kube-api-access-2vsv9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.658174 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.658002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.658174 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.658085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.658174 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.658129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.658174 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.658173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.758744 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.758744 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/20bd8fae-18fd-4ef3-8b69-f8ef57832424-kube-api-access-2vsv9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759033 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759033 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759033 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759033 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.758942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759225 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.759203 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759291 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.759220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.759367 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.759347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.761218 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.761200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20bd8fae-18fd-4ef3-8b69-f8ef57832424-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.761399 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.761383 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20bd8fae-18fd-4ef3-8b69-f8ef57832424-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.767651 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.767627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsv9\" (UniqueName: \"kubernetes.io/projected/20bd8fae-18fd-4ef3-8b69-f8ef57832424-kube-api-access-2vsv9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6bbzs\" (UID: \"20bd8fae-18fd-4ef3-8b69-f8ef57832424\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:40.885081 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:40.884992 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:41.017026 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:41.017003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs"] Jul 14 07:59:41.019106 ip-10-0-128-86 kubenswrapper[2556]: W0714 07:59:41.019077 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bd8fae_18fd_4ef3_8b69_f8ef57832424.slice/crio-2e65f736e2e760916c837c20cfd81561d55dbb1eed3e4907912c2ed8e8c38368 WatchSource:0}: Error finding container 2e65f736e2e760916c837c20cfd81561d55dbb1eed3e4907912c2ed8e8c38368: Status 404 returned error can't find the container with id 2e65f736e2e760916c837c20cfd81561d55dbb1eed3e4907912c2ed8e8c38368 Jul 14 07:59:41.256643 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:41.256561 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" event={"ID":"20bd8fae-18fd-4ef3-8b69-f8ef57832424","Type":"ContainerStarted","Data":"2e65f736e2e760916c837c20cfd81561d55dbb1eed3e4907912c2ed8e8c38368"} Jul 14 07:59:41.783613 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:41.783578 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:59:42.263252 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:42.263215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" event={"ID":"20bd8fae-18fd-4ef3-8b69-f8ef57832424","Type":"ContainerStarted","Data":"cde1037a23bf72f6adc3b0e70144e5a452bb42bbd98aedc5ca028d87c03360c7"} Jul 14 07:59:42.316377 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:42.316320 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" podStartSLOduration=1.160725049 podStartE2EDuration="2.31630098s" totalImagesPullingTime="1.155575931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 07:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 07:59:42.315426201 +0000 UTC m=+575.343571728" watchObservedRunningTime="2026-07-14 07:59:42.31630098 +0000 UTC m=+575.344446511" Jul 14 07:59:48.274975 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:48.274928 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 07:59:50.885760 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:50.885714 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:50.886201 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:50.886076 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:50.898504 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:50.898476 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:51.318987 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:51.318956 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6bbzs" Jul 14 07:59:58.381576 ip-10-0-128-86 kubenswrapper[2556]: I0714 07:59:58.381544 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:00:07.671282 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:00:07.671246 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:01:40.593909 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:01:40.593872 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:01:52.573612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:01:52.573574 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:02:02.282935 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:02:02.279554 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:02:11.181846 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:02:11.181796 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:02:22.973115 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:02:22.973075 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:02:50.984011 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:02:50.983971 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:03:03.998330 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:03:03.998290 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:03:42.325151 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:03:42.325114 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:03:51.594607 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:03:51.594568 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:02.077240 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:02.077207 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:09.778648 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:09.778612 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:21.689429 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:21.689396 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:32.875787 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:32.875752 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:44.272745 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:44.272710 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:04:53.983384 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:04:53.983347 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:05:16.474533 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:05:16.474491 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:05:27.383366 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:05:27.383330 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:05:51.178258 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:05:51.178221 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:06:04.173368 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:06:04.173327 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:06:19.680403 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:06:19.680361 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:06:31.383363 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:06:31.383325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:06:42.870372 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:06:42.870330 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:08:48.399348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:08:48.399301 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:08:58.073316 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:08:58.073283 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:09:14.984912 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:09:14.984871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:09:24.078344 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:09:24.078308 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:09:36.275694 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:09:36.275658 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:09:46.374518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:09:46.374467 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:09:55.276511 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:09:55.276471 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:10:06.669497 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:10:06.669462 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:10:18.076191 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:10:18.076155 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:10:26.076615 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:10:26.076582 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:10:37.871967 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:10:37.871931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:03.478131 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:03.478098 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:10.990772 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:10.990734 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:21.179690 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:21.179648 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:31.582153 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:31.582113 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:38.281094 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:38.281058 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:11:54.590363 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:11:54.590326 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:04.473248 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:04.473211 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:14.475948 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:14.475912 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:22.483101 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:22.483059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:32.380266 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:32.380230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:42.175908 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:42.175870 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:12:55.572278 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:12:55.572240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:13:04.983300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:13:04.983267 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:13:15.068835 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:13:15.068779 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:13:26.774484 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:13:26.774435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:13:39.676837 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:13:39.676781 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:13:48.778898 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:13:48.778864 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:14:00.985135 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:00.985059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:14:13.476130 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:13.476093 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:14:26.186380 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:26.186340 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:14:38.491570 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.491536 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:14:38.495014 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.494997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.500198 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.500175 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b1c5cd00-openshift-default-dockercfg-snr9x\"" Jul 14 08:14:38.518717 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.518678 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:14:38.609843 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.609843 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610066 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610066 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610066 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610066 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.609997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610268 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.610079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610268 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.610116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.610268 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.610144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bgc8\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711597 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711597 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711884 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711884 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711884 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.711884 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712094 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712094 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712094 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.711972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bgc8\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712241 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.712123 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712241 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.712154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712467 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.712434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712517 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.712503 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.712638 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.712613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.713939 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.713921 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.714249 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.714227 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.721915 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.721891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.722019 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.721917 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bgc8\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8\") pod \"e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.805066 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.805032 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:38.943777 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.943753 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:14:38.945235 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:14:38.945210 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557566a1_8810_46e4_9b41_959f1c8c6770.slice/crio-82349389a6c01001f7548c9d695ea31a3a89d2625015b93168b437b94e419614 WatchSource:0}: Error finding container 82349389a6c01001f7548c9d695ea31a3a89d2625015b93168b437b94e419614: Status 404 returned error can't find the container with id 82349389a6c01001f7548c9d695ea31a3a89d2625015b93168b437b94e419614 Jul 14 08:14:38.948524 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.947789 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:38.948524 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.947900 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:38.948524 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:38.947942 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:39.759958 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:39.759921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerStarted","Data":"c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c"} Jul 14 08:14:39.760347 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:39.759976 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerStarted","Data":"82349389a6c01001f7548c9d695ea31a3a89d2625015b93168b437b94e419614"} Jul 14 08:14:39.805357 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:39.805314 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:39.809632 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:39.809575 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podStartSLOduration=1.809558257 podStartE2EDuration="1.809558257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:14:39.808258802 +0000 UTC m=+1472.836404329" watchObservedRunningTime="2026-07-14 08:14:39.809558257 +0000 UTC m=+1472.837703783" Jul 14 08:14:40.811464 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:40.811434 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:41.769718 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:41.769688 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:41.770706 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:41.770685 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:42.574571 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:42.574534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:14:50.819327 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.819291 2556 generic.go:356] "Generic (PLEG): container finished" podID="557566a1-8810-46e4-9b41-959f1c8c6770" containerID="c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c" exitCode=0 Jul 14 08:14:50.819728 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.819362 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerDied","Data":"c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c"} Jul 14 08:14:50.819772 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.819729 2556 scope.go:117] "RemoveContainer" containerID="c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c" Jul 14 08:14:50.820793 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.820769 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:50.820872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.820851 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:50.820969 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:50.820886 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:14:51.827101 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:51.827064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerStarted","Data":"750202e483e6ca0686d88131c19a0f25f73295fcb97bb9db23b9ce25292114cb"} Jul 14 08:14:52.805210 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:52.805172 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:52.806473 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:52.806438 2556 patch_prober.go:28] interesting pod/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 14 08:14:52.806607 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:52.806505 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 14 08:14:53.806018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:53.805979 2556 patch_prober.go:28] interesting pod/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 14 08:14:53.806420 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:53.806038 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 14 08:14:54.806080 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:54.806043 2556 patch_prober.go:28] interesting pod/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 14 08:14:54.806473 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:54.806106 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 14 08:14:55.806056 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:55.806014 2556 patch_prober.go:28] interesting pod/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 14 08:14:55.806228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:55.806079 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 14 08:14:56.770573 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:56.770528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:56.809391 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:56.809359 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:14:56.853470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:14:56.853443 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:15:58.481644 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:15:58.481606 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:16:10.010659 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.010625 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:16:10.011104 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.010838 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" containerID="cri-o://750202e483e6ca0686d88131c19a0f25f73295fcb97bb9db23b9ce25292114cb" gracePeriod=30 Jul 14 08:16:10.570268 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.570231 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:16:10.573198 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.573180 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.575660 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.575636 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b0c3e934-gw-openshift-default-dockercfg-gjjml\"" Jul 14 08:16:10.591838 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.591794 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:16:10.662460 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzxc8\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662460 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.662974 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.662764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764111 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzxc8\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764111 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764787 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764762 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.764906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.764895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.765024 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.765002 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.765205 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.765186 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.766640 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.766617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.766917 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.766899 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.775331 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.775305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.775442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.775340 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzxc8\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8\") pod \"e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:10.886095 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:10.886011 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:11.026745 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.026700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:16:11.029390 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:16:11.029365 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d07b57_0265_4efe_8b03_916bc49f4371.slice/crio-3a5629f332fa51962d8baf3ef8edf564385bd8f0a016900fcf370c60d58157df WatchSource:0}: Error finding container 3a5629f332fa51962d8baf3ef8edf564385bd8f0a016900fcf370c60d58157df: Status 404 returned error can't find the container with id 3a5629f332fa51962d8baf3ef8edf564385bd8f0a016900fcf370c60d58157df Jul 14 08:16:11.031466 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.031436 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:11.031567 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.031527 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:11.031627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.031572 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:11.233950 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.233851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerStarted","Data":"027d500d68997111bf627ed6d14c397a6cb9423461d6f8032a0d114cf846bd80"} Jul 14 08:16:11.233950 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.233914 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerStarted","Data":"3a5629f332fa51962d8baf3ef8edf564385bd8f0a016900fcf370c60d58157df"} Jul 14 08:16:11.256360 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.256298 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podStartSLOduration=1.25627446 podStartE2EDuration="1.25627446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:16:11.254759227 +0000 UTC m=+1564.282904757" watchObservedRunningTime="2026-07-14 08:16:11.25627446 +0000 UTC m=+1564.284419989" Jul 14 08:16:11.854977 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.854943 2556 patch_prober.go:28] interesting pod/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 08:16:11.855134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.854999 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 08:16:11.886487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:11.886450 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:12.891959 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:12.891928 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:13.245196 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:13.245115 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:13.246276 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:13.246256 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:14.078554 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:14.078518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:16:15.257486 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.257454 2556 generic.go:356] "Generic (PLEG): container finished" podID="557566a1-8810-46e4-9b41-959f1c8c6770" containerID="750202e483e6ca0686d88131c19a0f25f73295fcb97bb9db23b9ce25292114cb" exitCode=0 Jul 14 08:16:15.257879 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.257535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerDied","Data":"750202e483e6ca0686d88131c19a0f25f73295fcb97bb9db23b9ce25292114cb"} Jul 14 08:16:15.257879 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.257682 2556 scope.go:117] "RemoveContainer" containerID="c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c" Jul 14 08:16:15.292583 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:16:15.292555 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c\": container with ID starting with c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c not found: ID does not exist" containerID="c9dd734cc51f53673864ef0bfea17cfe541e2765b252173c65ba88a4c5cb776c" Jul 14 08:16:15.294360 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.294339 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:16:15.409280 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409238 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bgc8\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409299 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409348 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409386 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409411 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409453 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409738 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409496 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409738 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409540 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409738 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409562 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket\") pod \"557566a1-8810-46e4-9b41-959f1c8c6770\" (UID: \"557566a1-8810-46e4-9b41-959f1c8c6770\") " Jul 14 08:16:15.409738 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409657 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:16:15.409738 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409687 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:16:15.410001 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.409984 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:16:15.410249 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.410221 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:16:15.410348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.410331 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.410540 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.410516 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.410637 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.410558 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data" (OuterVolumeSpecName: "istio-data") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:16:15.411827 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.411772 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8" (OuterVolumeSpecName: "kube-api-access-7bgc8") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "kube-api-access-7bgc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:16:15.411931 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.411783 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:16:15.411981 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.411936 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:16:15.412161 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.412144 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token" (OuterVolumeSpecName: "istio-token") pod "557566a1-8810-46e4-9b41-959f1c8c6770" (UID: "557566a1-8810-46e4-9b41-959f1c8c6770"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:16:15.511228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511192 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511222 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557566a1-8810-46e4-9b41-959f1c8c6770-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511231 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511453 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511242 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bgc8\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-kube-api-access-7bgc8\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511453 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511250 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557566a1-8810-46e4-9b41-959f1c8c6770-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511453 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511259 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557566a1-8810-46e4-9b41-959f1c8c6770-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:15.511453 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:15.511267 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557566a1-8810-46e4-9b41-959f1c8c6770-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:16:16.267282 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:16.267232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" event={"ID":"557566a1-8810-46e4-9b41-959f1c8c6770","Type":"ContainerDied","Data":"82349389a6c01001f7548c9d695ea31a3a89d2625015b93168b437b94e419614"} Jul 14 08:16:16.267756 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:16.267334 2556 scope.go:117] "RemoveContainer" containerID="750202e483e6ca0686d88131c19a0f25f73295fcb97bb9db23b9ce25292114cb" Jul 14 08:16:16.267756 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:16.267495 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w" Jul 14 08:16:16.290135 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:16.290081 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:16:16.293342 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:16.293319 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b1c5cd00-openshift-default-6f9b8dc655-2tp4w"] Jul 14 08:16:17.592960 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:17.592916 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" path="/var/lib/kubelet/pods/557566a1-8810-46e4-9b41-959f1c8c6770/volumes" Jul 14 08:16:22.305740 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.305708 2556 generic.go:356] "Generic (PLEG): container finished" podID="82d07b57-0265-4efe-8b03-916bc49f4371" containerID="027d500d68997111bf627ed6d14c397a6cb9423461d6f8032a0d114cf846bd80" exitCode=0 Jul 14 08:16:22.306242 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.305785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerDied","Data":"027d500d68997111bf627ed6d14c397a6cb9423461d6f8032a0d114cf846bd80"} Jul 14 08:16:22.306242 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.306181 2556 scope.go:117] "RemoveContainer" containerID="027d500d68997111bf627ed6d14c397a6cb9423461d6f8032a0d114cf846bd80" Jul 14 08:16:22.307271 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.307240 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:22.307371 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.307309 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:22.307371 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:22.307339 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:16:23.313035 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:23.313003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerStarted","Data":"4fbd294c2f2f949f828042a65d1008b7b67329ccec0a6287ca3f5329ab24d3fe"} Jul 14 08:16:23.886515 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:23.886473 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:23.887693 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:23.887668 2556 patch_prober.go:28] interesting pod/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 14 08:16:23.887838 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:23.887723 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 14 08:16:24.887553 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:24.887507 2556 patch_prober.go:28] interesting pod/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 14 08:16:24.888056 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:24.887584 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 14 08:16:25.887496 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:25.887448 2556 patch_prober.go:28] interesting pod/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 14 08:16:25.887710 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:25.887524 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 14 08:16:26.886838 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:26.886775 2556 patch_prober.go:28] interesting pod/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 14 08:16:26.887016 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:26.886867 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 14 08:16:27.891108 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:27.891071 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:27.891567 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:27.891349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:16:27.892057 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:16:27.892042 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:17:16.474382 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:16.474344 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:17:16.474844 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:16.474546 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" containerID="cri-o://4fbd294c2f2f949f828042a65d1008b7b67329ccec0a6287ca3f5329ab24d3fe" gracePeriod=30 Jul 14 08:17:19.282020 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:19.281987 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:17:21.618960 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.618927 2556 generic.go:356] "Generic (PLEG): container finished" podID="82d07b57-0265-4efe-8b03-916bc49f4371" containerID="4fbd294c2f2f949f828042a65d1008b7b67329ccec0a6287ca3f5329ab24d3fe" exitCode=0 Jul 14 08:17:21.619448 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.619007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerDied","Data":"4fbd294c2f2f949f828042a65d1008b7b67329ccec0a6287ca3f5329ab24d3fe"} Jul 14 08:17:21.619448 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.619078 2556 scope.go:117] "RemoveContainer" containerID="027d500d68997111bf627ed6d14c397a6cb9423461d6f8032a0d114cf846bd80" Jul 14 08:17:21.739387 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.739320 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:17:21.813536 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813504 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzxc8\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813536 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813539 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813572 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813599 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813636 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813708 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.813785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813735 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.814073 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813790 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.814073 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813844 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data\") pod \"82d07b57-0265-4efe-8b03-916bc49f4371\" (UID: \"82d07b57-0265-4efe-8b03-916bc49f4371\") " Jul 14 08:17:21.814073 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813980 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:17:21.814223 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.814142 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.814223 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.813989 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:17:21.814330 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.814300 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:17:21.814598 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.814531 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:17:21.814909 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.814880 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data" (OuterVolumeSpecName: "istio-data") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:17:21.816026 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.815977 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token" (OuterVolumeSpecName: "istio-token") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:17:21.816283 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.816257 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:17:21.816390 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.816259 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8" (OuterVolumeSpecName: "kube-api-access-lzxc8") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "kube-api-access-lzxc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:17:21.816434 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.816400 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82d07b57-0265-4efe-8b03-916bc49f4371" (UID: "82d07b57-0265-4efe-8b03-916bc49f4371"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:17:21.915435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915393 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82d07b57-0265-4efe-8b03-916bc49f4371-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915429 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82d07b57-0265-4efe-8b03-916bc49f4371-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915438 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915447 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915698 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915456 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzxc8\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-kube-api-access-lzxc8\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915698 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915464 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82d07b57-0265-4efe-8b03-916bc49f4371-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915698 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915472 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:21.915698 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:21.915480 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82d07b57-0265-4efe-8b03-916bc49f4371-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:17:22.626500 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.626464 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" Jul 14 08:17:22.626500 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.626485 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm" event={"ID":"82d07b57-0265-4efe-8b03-916bc49f4371","Type":"ContainerDied","Data":"3a5629f332fa51962d8baf3ef8edf564385bd8f0a016900fcf370c60d58157df"} Jul 14 08:17:22.626500 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.626554 2556 scope.go:117] "RemoveContainer" containerID="4fbd294c2f2f949f828042a65d1008b7b67329ccec0a6287ca3f5329ab24d3fe" Jul 14 08:17:22.636595 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.636565 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:17:22.637048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637030 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:17:22.637129 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637051 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:17:22.637129 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637080 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.637129 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637090 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.637129 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637112 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.637129 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637121 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.637369 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637205 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:17:22.637369 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637219 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.637369 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637228 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:17:22.637369 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.637238 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="557566a1-8810-46e4-9b41-959f1c8c6770" containerName="istio-proxy" Jul 14 08:17:22.640364 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.640344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.642461 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.642444 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c0f2014a-openshift-default-dockercfg-9jdxj\"" Jul 14 08:17:22.650220 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.650196 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:17:22.662173 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.662148 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:17:22.668028 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.667999 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b0c3e934-gw-openshift-default-7db4f69999-fhzqm"] Jul 14 08:17:22.720554 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720721 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720721 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmxx\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720721 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720721 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.720872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.720835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821303 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmxx\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821658 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821717 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821771 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821853 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.821930 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.821907 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.822125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.822100 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.822232 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.822132 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.822232 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.822150 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.822232 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.822187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.824018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.823992 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.824581 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.824562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.830340 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.830313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmxx\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.830527 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.830507 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token\") pod \"e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:22.952787 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:22.952703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:23.089694 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.089641 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:17:23.092076 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:17:23.092048 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25e349f_9365_4d24_a4a1_99f4afdc8f56.slice/crio-28a4a45ae1eb3ad2fb69d4a559e639d37351ffdf8dee4000ab75771fe60b2ea3 WatchSource:0}: Error finding container 28a4a45ae1eb3ad2fb69d4a559e639d37351ffdf8dee4000ab75771fe60b2ea3: Status 404 returned error can't find the container with id 28a4a45ae1eb3ad2fb69d4a559e639d37351ffdf8dee4000ab75771fe60b2ea3 Jul 14 08:17:23.094273 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.094240 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:23.094374 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.094322 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:23.094374 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.094367 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:23.592932 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.592886 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" path="/var/lib/kubelet/pods/82d07b57-0265-4efe-8b03-916bc49f4371/volumes" Jul 14 08:17:23.632586 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.632541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerStarted","Data":"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29"} Jul 14 08:17:23.633008 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.632604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerStarted","Data":"28a4a45ae1eb3ad2fb69d4a559e639d37351ffdf8dee4000ab75771fe60b2ea3"} Jul 14 08:17:23.655295 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.655248 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podStartSLOduration=1.6552291590000001 podStartE2EDuration="1.655229159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:17:23.65242533 +0000 UTC m=+1636.680570856" watchObservedRunningTime="2026-07-14 08:17:23.655229159 +0000 UTC m=+1636.683374686" Jul 14 08:17:23.953742 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:23.953663 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:24.957479 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:24.957450 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:25.643576 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:25.643545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:25.644764 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:25.644747 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:31.783279 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:31.783240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:17:39.718768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.718737 2556 generic.go:356] "Generic (PLEG): container finished" podID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerID="ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29" exitCode=0 Jul 14 08:17:39.719142 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.718776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerDied","Data":"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29"} Jul 14 08:17:39.719263 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.719246 2556 scope.go:117] "RemoveContainer" containerID="ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29" Jul 14 08:17:39.720301 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.720274 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:39.720365 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.720343 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:39.720405 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:39.720373 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:17:40.644127 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:40.644094 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:40.725908 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:40.725871 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerStarted","Data":"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4"} Jul 14 08:17:40.953037 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:40.952951 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:40.954180 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:40.954154 2556 patch_prober.go:28] interesting pod/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 14 08:17:40.954304 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:40.954203 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 14 08:17:41.953317 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:41.953282 2556 patch_prober.go:28] interesting pod/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 14 08:17:41.953714 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:41.953333 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 14 08:17:42.953165 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:42.953125 2556 patch_prober.go:28] interesting pod/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 14 08:17:42.953344 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:42.953194 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 14 08:17:43.953651 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:43.953615 2556 patch_prober.go:28] interesting pod/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 14 08:17:43.954074 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:43.953671 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 14 08:17:44.957432 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:44.957399 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:44.957879 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:44.957671 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:17:44.958439 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:17:44.958424 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:18:32.181572 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:32.181540 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:18:45.080403 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.080369 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:18:45.080842 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.080566 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" containerID="cri-o://697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4" gracePeriod=30 Jul 14 08:18:45.383018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.382923 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:18:45.383496 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.383474 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:18:45.383593 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.383500 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d07b57-0265-4efe-8b03-916bc49f4371" containerName="istio-proxy" Jul 14 08:18:45.385634 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.385612 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.387934 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.387914 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-98e5d5c2-openshift-default-dockercfg-qjzlf\"" Jul 14 08:18:45.399363 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.399335 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:18:45.464899 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.464857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.464899 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.464901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465109 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.464976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465109 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465010 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465109 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465109 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465109 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt25m\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465286 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.465286 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.465170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.565793 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.565793 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565871 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt25m\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.565993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566075 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566333 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566592 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.566870 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.566851 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.568604 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.568585 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.568838 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.568797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.574281 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.574254 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.574411 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.574393 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt25m\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m\") pod \"e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.696439 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.696346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:45.828553 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.828529 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:18:45.830611 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:18:45.830585 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f121201_676f_4caf_a9ef_50a9198fc9e8.slice/crio-a7b1aba173ebd0d2705794ba9c281831e2c3000eb1404613c8471d49c0705826 WatchSource:0}: Error finding container a7b1aba173ebd0d2705794ba9c281831e2c3000eb1404613c8471d49c0705826: Status 404 returned error can't find the container with id a7b1aba173ebd0d2705794ba9c281831e2c3000eb1404613c8471d49c0705826 Jul 14 08:18:45.833277 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.833242 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:45.833397 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.833322 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:45.833397 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:45.833367 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:46.059556 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:46.059510 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerStarted","Data":"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256"} Jul 14 08:18:46.059744 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:46.059580 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerStarted","Data":"a7b1aba173ebd0d2705794ba9c281831e2c3000eb1404613c8471d49c0705826"} Jul 14 08:18:46.082472 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:46.082426 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podStartSLOduration=1.082408989 podStartE2EDuration="1.082408989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:18:46.080937041 +0000 UTC m=+1719.109082570" watchObservedRunningTime="2026-07-14 08:18:46.082408989 +0000 UTC m=+1719.110554516" Jul 14 08:18:46.696629 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:46.696594 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:46.702044 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:46.702017 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:47.064723 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:47.064695 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:47.065707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:47.065681 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:49.482862 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:49.482822 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:18:50.336253 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.336231 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:18:50.410161 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410132 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmmxx\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410161 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410169 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410193 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410223 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410251 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410302 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410349 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410379 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410639 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410443 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert\") pod \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\" (UID: \"d25e349f-9365-4d24-a4a1-99f4afdc8f56\") " Jul 14 08:18:50.410639 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410563 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:18:50.410745 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410667 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:18:50.411235 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410858 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.411235 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410882 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.411235 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.410892 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:18:50.411235 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.411188 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:18:50.411718 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.411695 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data" (OuterVolumeSpecName: "istio-data") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:18:50.412586 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.412559 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx" (OuterVolumeSpecName: "kube-api-access-mmmxx") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "kube-api-access-mmmxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:18:50.413117 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.413092 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:18:50.413234 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.413211 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token" (OuterVolumeSpecName: "istio-token") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:18:50.413300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.413277 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d25e349f-9365-4d24-a4a1-99f4afdc8f56" (UID: "d25e349f-9365-4d24-a4a1-99f4afdc8f56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:18:50.512033 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.511987 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmmxx\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-kube-api-access-mmmxx\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512033 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512024 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512033 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512034 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512033 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512042 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512507 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512050 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512507 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512059 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:50.512507 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:50.512066 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d25e349f-9365-4d24-a4a1-99f4afdc8f56-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:18:51.089019 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.088989 2556 generic.go:356] "Generic (PLEG): container finished" podID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerID="697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4" exitCode=0 Jul 14 08:18:51.089202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.089046 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" Jul 14 08:18:51.089202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.089073 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerDied","Data":"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4"} Jul 14 08:18:51.089202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.089127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84" event={"ID":"d25e349f-9365-4d24-a4a1-99f4afdc8f56","Type":"ContainerDied","Data":"28a4a45ae1eb3ad2fb69d4a559e639d37351ffdf8dee4000ab75771fe60b2ea3"} Jul 14 08:18:51.089202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.089154 2556 scope.go:117] "RemoveContainer" containerID="697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4" Jul 14 08:18:51.098530 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.098511 2556 scope.go:117] "RemoveContainer" containerID="ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29" Jul 14 08:18:51.106502 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.106485 2556 scope.go:117] "RemoveContainer" containerID="697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4" Jul 14 08:18:51.106727 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:18:51.106711 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4\": container with ID starting with 697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4 not found: ID does not exist" containerID="697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4" Jul 14 08:18:51.106775 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.106734 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4"} err="failed to get container status \"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4\": rpc error: code = NotFound desc = could not find container \"697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4\": container with ID starting with 697ed93f4b3ac16f38db41ea925bebb1b919549580d3e0970c5cc35a6f2b7ce4 not found: ID does not exist" Jul 14 08:18:51.106775 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.106764 2556 scope.go:117] "RemoveContainer" containerID="ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29" Jul 14 08:18:51.106993 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:18:51.106975 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29\": container with ID starting with ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29 not found: ID does not exist" containerID="ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29" Jul 14 08:18:51.107030 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.106996 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29"} err="failed to get container status \"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29\": rpc error: code = NotFound desc = could not find container \"ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29\": container with ID starting with ab697829e8b8efd1761e72b59dafa987a71976d7a5bd9ebf6c02b191ec0a7e29 not found: ID does not exist" Jul 14 08:18:51.113716 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.113686 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:18:51.118305 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.118282 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c0f2014a-openshift-default-77b47cdfbf-csw84"] Jul 14 08:18:51.596764 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:51.596732 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" path="/var/lib/kubelet/pods/d25e349f-9365-4d24-a4a1-99f4afdc8f56/volumes" Jul 14 08:18:58.130819 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.130763 2556 generic.go:356] "Generic (PLEG): container finished" podID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerID="1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256" exitCode=0 Jul 14 08:18:58.131255 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.130839 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerDied","Data":"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256"} Jul 14 08:18:58.131309 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.131272 2556 scope.go:117] "RemoveContainer" containerID="1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256" Jul 14 08:18:58.132388 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.132360 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:58.132452 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.132431 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:58.132484 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:58.132461 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:18:59.137866 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:59.137833 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerStarted","Data":"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103"} Jul 14 08:18:59.696625 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:59.696590 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:18:59.697767 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:59.697738 2556 patch_prober.go:28] interesting pod/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 14 08:18:59.697907 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:18:59.697818 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 14 08:19:00.697327 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:00.697287 2556 patch_prober.go:28] interesting pod/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 14 08:19:00.697712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:00.697349 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 14 08:19:01.697232 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:01.697195 2556 patch_prober.go:28] interesting pod/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 14 08:19:01.697408 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:01.697254 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 14 08:19:02.065637 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:02.064829 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:19:02.697694 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:02.697651 2556 patch_prober.go:28] interesting pod/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 14 08:19:02.698224 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:02.697716 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 14 08:19:03.701080 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:03.701050 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:19:03.702189 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:03.702168 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:19:54.173053 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:19:54.173018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:20:06.238579 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:06.238541 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:20:06.239023 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:06.238814 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" containerID="cri-o://c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103" gracePeriod=30 Jul 14 08:20:11.495190 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.495161 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:20:11.508610 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.508536 2556 generic.go:356] "Generic (PLEG): container finished" podID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerID="c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103" exitCode=0 Jul 14 08:20:11.508610 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.508583 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" Jul 14 08:20:11.508769 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.508621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerDied","Data":"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103"} Jul 14 08:20:11.508769 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.508674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v" event={"ID":"9f121201-676f-4caf-a9ef-50a9198fc9e8","Type":"ContainerDied","Data":"a7b1aba173ebd0d2705794ba9c281831e2c3000eb1404613c8471d49c0705826"} Jul 14 08:20:11.508769 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.508698 2556 scope.go:117] "RemoveContainer" containerID="c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103" Jul 14 08:20:11.517951 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.517929 2556 scope.go:117] "RemoveContainer" containerID="1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256" Jul 14 08:20:11.528398 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.528372 2556 scope.go:117] "RemoveContainer" containerID="c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103" Jul 14 08:20:11.528690 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:20:11.528671 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103\": container with ID starting with c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103 not found: ID does not exist" containerID="c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103" Jul 14 08:20:11.528775 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.528699 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103"} err="failed to get container status \"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103\": rpc error: code = NotFound desc = could not find container \"c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103\": container with ID starting with c423dbcc1ef012d55af865afdabb87b3f8248be51c5ebe1f1ab7727e875cd103 not found: ID does not exist" Jul 14 08:20:11.528775 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.528720 2556 scope.go:117] "RemoveContainer" containerID="1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256" Jul 14 08:20:11.529009 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:20:11.528985 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256\": container with ID starting with 1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256 not found: ID does not exist" containerID="1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256" Jul 14 08:20:11.529079 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.529016 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256"} err="failed to get container status \"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256\": rpc error: code = NotFound desc = could not find container \"1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256\": container with ID starting with 1a0147a56f1e473f3d2a222c00115e1a0f4a2f38db5da89681dfc6f83aaa5256 not found: ID does not exist" Jul 14 08:20:11.635450 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635419 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635460 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635480 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635509 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635539 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635585 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635613 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635937 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635638 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt25m\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635937 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635661 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token\") pod \"9f121201-676f-4caf-a9ef-50a9198fc9e8\" (UID: \"9f121201-676f-4caf-a9ef-50a9198fc9e8\") " Jul 14 08:20:11.635937 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635766 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:20:11.636103 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.635964 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.636103 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.636064 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:20:11.636191 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.636128 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:20:11.636287 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.636268 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:20:11.636480 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.636458 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:20:11.637832 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.637789 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:20:11.637964 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.637912 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:20:11.638171 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.638148 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:20:11.638308 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.638210 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m" (OuterVolumeSpecName: "kube-api-access-tt25m") pod "9f121201-676f-4caf-a9ef-50a9198fc9e8" (UID: "9f121201-676f-4caf-a9ef-50a9198fc9e8"). InnerVolumeSpecName "kube-api-access-tt25m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:20:11.736380 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736344 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736380 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736372 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f121201-676f-4caf-a9ef-50a9198fc9e8-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736380 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736381 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt25m\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-kube-api-access-tt25m\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736390 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736400 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736408 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736415 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.736611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.736423 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f121201-676f-4caf-a9ef-50a9198fc9e8-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:20:11.831089 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.831061 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:20:11.839064 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:11.839038 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-98e5d5c2-openshift-default-665f7d4fbc-g7b4v"] Jul 14 08:20:13.593475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:20:13.593438 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" path="/var/lib/kubelet/pods/9f121201-676f-4caf-a9ef-50a9198fc9e8/volumes" Jul 14 08:21:28.881003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:28.880909 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:21:36.773333 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:36.773288 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:21:42.773021 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.772985 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773342 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773354 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773367 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773373 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773383 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773389 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773398 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773403 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773452 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773459 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.773487 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.773467 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f121201-676f-4caf-a9ef-50a9198fc9e8" containerName="istio-proxy" Jul 14 08:21:42.775275 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.775259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.777739 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.777718 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b112a181-openshift-default-dockercfg-2d2mf\"" Jul 14 08:21:42.803035 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.803002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:21:42.897833 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.897760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.897841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.897887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.897953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.897980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsxpc\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.898045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898311 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.898083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898311 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.898106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.898311 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.898133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.998746 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.998746 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsxpc\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.998972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999402 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999538 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999628 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999534 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999628 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:42.999742 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:42.999691 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.001328 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.001303 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.001521 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.001501 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.009926 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.009898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsxpc\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.010032 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.009998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token\") pod \"e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.085876 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.085758 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:43.226111 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.226087 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:21:43.227277 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:21:43.227251 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f851a60_520d_4f85_80f6_46281f2088eb.slice/crio-a7ed62ad3d58179313eadcf3dcdf7cebeb37a03c1cf05994fb8e5148ab3b9553 WatchSource:0}: Error finding container a7ed62ad3d58179313eadcf3dcdf7cebeb37a03c1cf05994fb8e5148ab3b9553: Status 404 returned error can't find the container with id a7ed62ad3d58179313eadcf3dcdf7cebeb37a03c1cf05994fb8e5148ab3b9553 Jul 14 08:21:43.229317 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.229286 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:21:43.229411 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.229363 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:21:43.229477 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.229408 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:21:43.977062 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.977024 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerStarted","Data":"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e"} Jul 14 08:21:43.977444 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:43.977082 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerStarted","Data":"a7ed62ad3d58179313eadcf3dcdf7cebeb37a03c1cf05994fb8e5148ab3b9553"} Jul 14 08:21:44.002121 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:44.002054 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podStartSLOduration=2.002030543 podStartE2EDuration="2.002030543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:21:44.0001043 +0000 UTC m=+1897.028249858" watchObservedRunningTime="2026-07-14 08:21:44.002030543 +0000 UTC m=+1897.030176072" Jul 14 08:21:44.086893 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:44.086850 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:44.091595 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:44.091572 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:44.982037 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:44.982003 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:44.983049 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:44.983029 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:21:46.677707 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:46.677673 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:21:56.775076 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:21:56.775028 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:22:00.232727 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:00.232690 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:50762->10.134.0.36:15021: read: connection reset by peer" start-of-body= Jul 14 08:22:00.233166 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:00.232755 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:50762->10.134.0.36:15021: read: connection reset by peer" Jul 14 08:22:01.062659 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.062628 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f851a60-520d-4f85-80f6-46281f2088eb" containerID="e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e" exitCode=0 Jul 14 08:22:01.062852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.062712 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerDied","Data":"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e"} Jul 14 08:22:01.063142 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.063128 2556 scope.go:117] "RemoveContainer" containerID="e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e" Jul 14 08:22:01.064174 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.064150 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:01.064223 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.064216 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:01.064262 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:01.064249 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:02.072994 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:02.072942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerStarted","Data":"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899"} Jul 14 08:22:02.086356 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:02.086316 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:02.086709 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:02.086678 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 08:22:02.086870 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:02.086741 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 08:22:03.086407 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:03.086370 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 08:22:03.086918 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:03.086434 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 08:22:04.086905 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:04.086866 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 08:22:04.087392 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:04.086931 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 08:22:05.087001 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:05.086958 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 08:22:05.087412 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:05.087031 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 08:22:06.087139 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:06.087102 2556 patch_prober.go:28] interesting pod/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 14 08:22:06.087541 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:06.087187 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 14 08:22:07.090617 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:07.090576 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:07.091114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:07.090994 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:07.091732 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:07.091716 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:11.684973 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:11.684928 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:22:23.724953 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:23.724919 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:22:23.725534 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:23.725142 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" containerID="cri-o://12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899" gracePeriod=30 Jul 14 08:22:28.986201 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:28.986134 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:29.117058 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117018 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117069 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117113 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117137 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117163 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117190 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117214 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117252 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsxpc\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117604 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117316 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo\") pod \"6f851a60-520d-4f85-80f6-46281f2088eb\" (UID: \"6f851a60-520d-4f85-80f6-46281f2088eb\") " Jul 14 08:22:29.117604 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117335 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:22:29.117604 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117441 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:22:29.117768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117604 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:22:29.117768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117601 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:22:29.117768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117654 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.117768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117675 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.118016 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.117991 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:22:29.119517 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.119487 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:22:29.119517 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.119506 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:22:29.119782 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.119755 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:22:29.119782 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.119768 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc" (OuterVolumeSpecName: "kube-api-access-vsxpc") pod "6f851a60-520d-4f85-80f6-46281f2088eb" (UID: "6f851a60-520d-4f85-80f6-46281f2088eb"). InnerVolumeSpecName "kube-api-access-vsxpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:22:29.218285 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218253 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851a60-520d-4f85-80f6-46281f2088eb-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218285 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218280 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218285 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218290 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218298 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851a60-520d-4f85-80f6-46281f2088eb-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218305 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218313 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851a60-520d-4f85-80f6-46281f2088eb-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.218518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.218321 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsxpc\" (UniqueName: \"kubernetes.io/projected/6f851a60-520d-4f85-80f6-46281f2088eb-kube-api-access-vsxpc\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:22:29.220713 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.220687 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f851a60-520d-4f85-80f6-46281f2088eb" containerID="12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899" exitCode=0 Jul 14 08:22:29.220845 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.220736 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" Jul 14 08:22:29.220845 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.220737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerDied","Data":"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899"} Jul 14 08:22:29.220926 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.220870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc" event={"ID":"6f851a60-520d-4f85-80f6-46281f2088eb","Type":"ContainerDied","Data":"a7ed62ad3d58179313eadcf3dcdf7cebeb37a03c1cf05994fb8e5148ab3b9553"} Jul 14 08:22:29.220926 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.220911 2556 scope.go:117] "RemoveContainer" containerID="12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899" Jul 14 08:22:29.230286 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.230266 2556 scope.go:117] "RemoveContainer" containerID="e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e" Jul 14 08:22:29.239098 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.239078 2556 scope.go:117] "RemoveContainer" containerID="12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899" Jul 14 08:22:29.239369 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:22:29.239350 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899\": container with ID starting with 12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899 not found: ID does not exist" containerID="12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899" Jul 14 08:22:29.239461 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.239378 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899"} err="failed to get container status \"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899\": rpc error: code = NotFound desc = could not find container \"12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899\": container with ID starting with 12d92ebf38dd626ed62ba6fa4be169e6a90636424f6bfc718d1551b873711899 not found: ID does not exist" Jul 14 08:22:29.239461 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.239399 2556 scope.go:117] "RemoveContainer" containerID="e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e" Jul 14 08:22:29.239676 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:22:29.239659 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e\": container with ID starting with e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e not found: ID does not exist" containerID="e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e" Jul 14 08:22:29.239715 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.239681 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e"} err="failed to get container status \"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e\": rpc error: code = NotFound desc = could not find container \"e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e\": container with ID starting with e062a5cf29129749717331aa9ed4d89dbd5cc9f8e7142281fbe15b4da1d8a77e not found: ID does not exist" Jul 14 08:22:29.246356 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.246331 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:22:29.249577 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.249554 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b112a181-openshift-default-8464c4cf6c-vn2jc"] Jul 14 08:22:29.593039 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:29.593005 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" path="/var/lib/kubelet/pods/6f851a60-520d-4f85-80f6-46281f2088eb/volumes" Jul 14 08:22:43.476988 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.476952 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:22:43.477530 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477511 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.477611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477533 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.477611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477553 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.477611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477562 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.477754 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477639 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25e349f-9365-4d24-a4a1-99f4afdc8f56" containerName="istio-proxy" Jul 14 08:22:43.477754 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477656 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.477754 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.477667 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f851a60-520d-4f85-80f6-46281f2088eb" containerName="istio-proxy" Jul 14 08:22:43.479766 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.479745 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.482164 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.482145 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9a0f7fb2-openshift-default-dockercfg-gpn2c\"" Jul 14 08:22:43.492850 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.492823 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:22:43.647023 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.646988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647023 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647421 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqsj9\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.647421 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.647345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748419 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748419 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748419 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqsj9\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.748712 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.748727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749064 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.749027 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749110 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.749077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749196 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.749176 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749282 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.749267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.749393 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.749360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.750915 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.750894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.751010 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.750976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.756090 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.756068 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.756174 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.756154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqsj9\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9\") pod \"e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.789785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.789753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:43.932165 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.932139 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:22:43.934252 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:22:43.934222 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc057671_8277_4607_b527_1593a1e5cef4.slice/crio-fa105b0266488159bda7143fa6fbb1724e005b156a11aa0d473ce0a1ff26ceef WatchSource:0}: Error finding container fa105b0266488159bda7143fa6fbb1724e005b156a11aa0d473ce0a1ff26ceef: Status 404 returned error can't find the container with id fa105b0266488159bda7143fa6fbb1724e005b156a11aa0d473ce0a1ff26ceef Jul 14 08:22:43.936706 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.936673 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:43.936774 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.936754 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:43.936854 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:43.936783 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:22:44.298894 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:44.298850 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerStarted","Data":"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1"} Jul 14 08:22:44.299071 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:44.298913 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerStarted","Data":"fa105b0266488159bda7143fa6fbb1724e005b156a11aa0d473ce0a1ff26ceef"} Jul 14 08:22:44.319742 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:44.319686 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podStartSLOduration=1.319669955 podStartE2EDuration="1.319669955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:22:44.317874983 +0000 UTC m=+1957.346020511" watchObservedRunningTime="2026-07-14 08:22:44.319669955 +0000 UTC m=+1957.347815483" Jul 14 08:22:44.790604 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:44.790566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:44.795349 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:44.795324 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:45.304333 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:45.304299 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:45.305328 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:45.305310 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:22:52.568827 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:22:52.568774 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:23:00.305961 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.305928 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 08:23:00.306295 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.305998 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 08:23:00.384670 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.384639 2556 generic.go:356] "Generic (PLEG): container finished" podID="bc057671-8277-4607-b527-1593a1e5cef4" containerID="27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1" exitCode=0 Jul 14 08:23:00.384847 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.384710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerDied","Data":"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1"} Jul 14 08:23:00.385158 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.385143 2556 scope.go:117] "RemoveContainer" containerID="27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1" Jul 14 08:23:00.386165 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.386141 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:23:00.386222 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.386202 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:23:00.386257 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:00.386235 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:23:01.393529 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:01.393495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerStarted","Data":"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1"} Jul 14 08:23:01.790549 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:01.790518 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:23:01.790724 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:01.790665 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 08:23:01.790724 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:01.790709 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 08:23:02.790860 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:02.790789 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 08:23:02.791264 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:02.790881 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 08:23:03.791031 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:03.790997 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 08:23:03.791432 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:03.791057 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 08:23:04.576142 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:04.576081 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:23:04.790967 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:04.790923 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 14 08:23:04.791144 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:04.790996 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 14 08:23:05.793957 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:05.793918 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:23:05.794447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:05.794422 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:23:05.795188 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:05.795172 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:23:20.679054 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:20.679019 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:23:37.616334 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:23:37.616298 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:24:31.271308 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:31.271273 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:24:31.271880 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:31.271534 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" containerID="cri-o://9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1" gracePeriod=30 Jul 14 08:24:35.689048 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:35.689013 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:24:35.797040 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:35.796996 2556 patch_prober.go:28] interesting pod/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 08:24:35.797212 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:35.797070 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 08:24:36.521114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.521088 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:24:36.582613 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582516 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582613 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582565 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582625 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582644 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqsj9\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582661 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582686 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582747 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582783 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.582874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582825 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data\") pod \"bc057671-8277-4607-b527-1593a1e5cef4\" (UID: \"bc057671-8277-4607-b527-1593a1e5cef4\") " Jul 14 08:24:36.583238 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.582901 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:24:36.583238 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.583138 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.583238 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.583161 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:24:36.583238 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.583212 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:24:36.583432 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.583378 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:24:36.583863 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.583841 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:24:36.585247 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.585220 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:24:36.585436 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.585421 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9" (OuterVolumeSpecName: "kube-api-access-tqsj9") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "kube-api-access-tqsj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:24:36.585510 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.585451 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:24:36.585564 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.585518 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc057671-8277-4607-b527-1593a1e5cef4" (UID: "bc057671-8277-4607-b527-1593a1e5cef4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:24:36.684491 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684450 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc057671-8277-4607-b527-1593a1e5cef4-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684491 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684485 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684491 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684495 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqsj9\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-kube-api-access-tqsj9\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684491 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684505 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc057671-8277-4607-b527-1593a1e5cef4-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684770 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684513 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc057671-8277-4607-b527-1593a1e5cef4-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684770 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684521 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684770 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684528 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.684770 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.684536 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc057671-8277-4607-b527-1593a1e5cef4-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:24:36.876563 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.876477 2556 generic.go:356] "Generic (PLEG): container finished" podID="bc057671-8277-4607-b527-1593a1e5cef4" containerID="9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1" exitCode=0 Jul 14 08:24:36.876563 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.876524 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" Jul 14 08:24:36.877044 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.876571 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerDied","Data":"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1"} Jul 14 08:24:36.877044 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.876633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f" event={"ID":"bc057671-8277-4607-b527-1593a1e5cef4","Type":"ContainerDied","Data":"fa105b0266488159bda7143fa6fbb1724e005b156a11aa0d473ce0a1ff26ceef"} Jul 14 08:24:36.877044 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.876661 2556 scope.go:117] "RemoveContainer" containerID="9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1" Jul 14 08:24:36.885970 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.885942 2556 scope.go:117] "RemoveContainer" containerID="27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1" Jul 14 08:24:36.894169 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.894147 2556 scope.go:117] "RemoveContainer" containerID="9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1" Jul 14 08:24:36.894451 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:24:36.894425 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1\": container with ID starting with 9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1 not found: ID does not exist" containerID="9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1" Jul 14 08:24:36.894511 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.894452 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1"} err="failed to get container status \"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1\": rpc error: code = NotFound desc = could not find container \"9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1\": container with ID starting with 9b11a7028e54563b2c2c4b33f130da1ba1ec393acbb37e6e9b4ee0b90c58dfc1 not found: ID does not exist" Jul 14 08:24:36.894511 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.894473 2556 scope.go:117] "RemoveContainer" containerID="27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1" Jul 14 08:24:36.894751 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:24:36.894736 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1\": container with ID starting with 27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1 not found: ID does not exist" containerID="27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1" Jul 14 08:24:36.894833 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.894754 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1"} err="failed to get container status \"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1\": rpc error: code = NotFound desc = could not find container \"27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1\": container with ID starting with 27cdac5d58d952eddab203d4b607be3732b9f61229329185a8354ee9f4d302e1 not found: ID does not exist" Jul 14 08:24:36.899070 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.899047 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:24:36.907866 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:36.907844 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9a0f7fb2-openshift-default-5f868b9675-2kb9f"] Jul 14 08:24:37.593680 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:37.593646 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc057671-8277-4607-b527-1593a1e5cef4" path="/var/lib/kubelet/pods/bc057671-8277-4607-b527-1593a1e5cef4/volumes" Jul 14 08:24:49.393203 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:24:49.393166 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:25:26.032100 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.032059 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:25:26.032602 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.032557 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:26.032602 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.032578 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:26.032725 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.032693 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:26.032725 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.032708 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:26.035680 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.035659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.038538 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.038519 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5ae22d-openshift-default-dockercfg-cltpd\"" Jul 14 08:25:26.059632 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.059604 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:25:26.108180 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108180 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108341 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108741 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.108741 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.108549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzbb\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209056 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzbb\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209140 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209202 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209620 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209675 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209656 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209934 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.209934 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.209898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.210130 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.210039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.210406 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.210382 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.211608 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.211587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.211891 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.211873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.217364 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.217341 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzbb\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.217464 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.217415 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token\") pod \"e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.346018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.345922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:26.485368 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.485336 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:25:26.486772 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:25:26.486748 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode721bf2d_42ef_441c_b915_fb4ce68a39f9.slice/crio-074da6aeada35104c4c33fbe4e3f08c10bdd804497f6c7acd2d192cd3d77b8bf WatchSource:0}: Error finding container 074da6aeada35104c4c33fbe4e3f08c10bdd804497f6c7acd2d192cd3d77b8bf: Status 404 returned error can't find the container with id 074da6aeada35104c4c33fbe4e3f08c10bdd804497f6c7acd2d192cd3d77b8bf Jul 14 08:25:26.488935 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.488907 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:26.489013 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.488970 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:26.489013 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:26.489000 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:27.126518 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:27.126484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerStarted","Data":"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81"} Jul 14 08:25:27.126957 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:27.126541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerStarted","Data":"074da6aeada35104c4c33fbe4e3f08c10bdd804497f6c7acd2d192cd3d77b8bf"} Jul 14 08:25:27.151233 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:27.151181 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podStartSLOduration=1.15116362 podStartE2EDuration="1.15116362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:25:27.149325948 +0000 UTC m=+2120.177471479" watchObservedRunningTime="2026-07-14 08:25:27.15116362 +0000 UTC m=+2120.179309146" Jul 14 08:25:27.346892 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:27.346846 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:27.352468 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:27.352446 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:28.131560 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:28.131530 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:28.132479 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:28.132465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:34.259845 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.259796 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:25:34.260216 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.260180 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:34.260216 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.260192 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc057671-8277-4607-b527-1593a1e5cef4" containerName="istio-proxy" Jul 14 08:25:34.263399 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.263376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.265895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.265870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-bf6952-openshift-default-dockercfg-hmz7x\"" Jul 14 08:25:34.276936 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.276910 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:25:34.386163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckjc\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386528 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.386528 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.386446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487420 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487420 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487621 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487621 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487621 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487621 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487621 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487907 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.487907 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487657 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckjc\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.488020 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.487967 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.488078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.488030 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.488078 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.488058 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.488281 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.488256 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.488402 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.488291 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.489659 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.489641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.490114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.490090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.496442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.496424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckjc\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.496521 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.496491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token\") pod \"e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.573932 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.573884 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:34.712217 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.712191 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:25:34.715326 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:25:34.715299 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6271c4a_f76d_48b2_b217_530e533280d6.slice/crio-06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de WatchSource:0}: Error finding container 06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de: Status 404 returned error can't find the container with id 06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de Jul 14 08:25:34.717481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.717449 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:34.717566 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.717516 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:34.717566 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:34.717544 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:35.169157 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:35.169126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerStarted","Data":"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb"} Jul 14 08:25:35.169374 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:35.169175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerStarted","Data":"06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de"} Jul 14 08:25:35.190877 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:35.190795 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podStartSLOduration=1.190772244 podStartE2EDuration="1.190772244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:25:35.189463826 +0000 UTC m=+2128.217609355" watchObservedRunningTime="2026-07-14 08:25:35.190772244 +0000 UTC m=+2128.218917798" Jul 14 08:25:35.574547 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:35.574507 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:35.579507 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:35.579479 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:36.174167 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:36.174137 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:36.175200 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:36.175182 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:37.390573 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:37.390538 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:25:44.172974 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:44.172935 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 08:25:44.173397 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:44.172993 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 08:25:45.224640 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.224543 2556 generic.go:356] "Generic (PLEG): container finished" podID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerID="984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81" exitCode=0 Jul 14 08:25:45.224640 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.224582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerDied","Data":"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81"} Jul 14 08:25:45.225100 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.224993 2556 scope.go:117] "RemoveContainer" containerID="984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81" Jul 14 08:25:45.226009 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.225981 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:45.226082 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.226050 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:45.226122 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:45.226081 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:46.231018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:46.230981 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerStarted","Data":"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98"} Jul 14 08:25:46.346418 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:46.346385 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:46.346586 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:46.346483 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 14 08:25:46.346586 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:46.346516 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 14 08:25:47.346567 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:47.346529 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 14 08:25:47.347069 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:47.346605 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 14 08:25:48.346345 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:48.346305 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 14 08:25:48.346532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:48.346377 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 14 08:25:49.347202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:49.347159 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 14 08:25:49.347597 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:49.347223 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 14 08:25:50.347122 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:50.347083 2556 patch_prober.go:28] interesting pod/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 14 08:25:50.347308 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:50.347142 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 14 08:25:50.472979 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:50.472942 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:25:51.350215 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:51.350176 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:51.350612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:51.350545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:51.351244 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:51.351224 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:25:52.216009 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:52.215958 2556 patch_prober.go:28] interesting pod/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 08:25:52.216194 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:52.216029 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 08:25:53.272099 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.272062 2556 generic.go:356] "Generic (PLEG): container finished" podID="c6271c4a-f76d-48b2-b217-530e533280d6" containerID="9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb" exitCode=0 Jul 14 08:25:53.272623 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.272132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerDied","Data":"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb"} Jul 14 08:25:53.272623 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.272554 2556 scope.go:117] "RemoveContainer" containerID="9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb" Jul 14 08:25:53.273568 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.273543 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:53.273659 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.273611 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:53.273659 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:53.273644 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:25:54.282703 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:54.282659 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerStarted","Data":"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564"} Jul 14 08:25:54.574730 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:54.574620 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:54.574940 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:54.574758 2556 patch_prober.go:28] interesting pod/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 14 08:25:54.574940 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:54.574826 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 14 08:25:55.575122 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:55.575084 2556 patch_prober.go:28] interesting pod/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 14 08:25:55.576130 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:55.575692 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 14 08:25:56.574728 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:56.574671 2556 patch_prober.go:28] interesting pod/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 14 08:25:56.574970 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:56.574772 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 14 08:25:57.575151 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:57.575110 2556 patch_prober.go:28] interesting pod/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 14 08:25:57.575769 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:57.575735 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 14 08:25:58.578539 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:58.578504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:58.578935 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:58.578767 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:25:58.579605 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:25:58.579587 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:26:38.075364 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:26:38.075324 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:26:51.174045 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:26:51.174003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:27:07.977117 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:07.977073 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:27:18.375040 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:18.375003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:27:22.428956 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:22.428918 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:27:22.429375 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:22.429172 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" containerID="cri-o://7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98" gracePeriod=30 Jul 14 08:27:27.681184 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.681159 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:27:27.727916 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.727818 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.727916 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.727876 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.727916 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.727905 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.727956 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728000 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728042 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728066 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qzbb\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728096 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token\") pod \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\" (UID: \"e721bf2d-42ef-441c-b915-fb4ce68a39f9\") " Jul 14 08:27:27.728501 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728250 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:27.728501 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728320 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:27.728501 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728465 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.728501 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728485 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.728725 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728611 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:27:27.728725 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728615 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:27.728870 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.728847 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:27.730125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.730102 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:27.730338 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.730317 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:27:27.730522 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.730496 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:27:27.730522 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.730502 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb" (OuterVolumeSpecName: "kube-api-access-7qzbb") pod "e721bf2d-42ef-441c-b915-fb4ce68a39f9" (UID: "e721bf2d-42ef-441c-b915-fb4ce68a39f9"). InnerVolumeSpecName "kube-api-access-7qzbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:27:27.757075 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.757045 2556 generic.go:356] "Generic (PLEG): container finished" podID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerID="7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98" exitCode=0 Jul 14 08:27:27.757256 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.757099 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" Jul 14 08:27:27.757256 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.757127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerDied","Data":"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98"} Jul 14 08:27:27.757256 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.757184 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd" event={"ID":"e721bf2d-42ef-441c-b915-fb4ce68a39f9","Type":"ContainerDied","Data":"074da6aeada35104c4c33fbe4e3f08c10bdd804497f6c7acd2d192cd3d77b8bf"} Jul 14 08:27:27.757256 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.757208 2556 scope.go:117] "RemoveContainer" containerID="7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98" Jul 14 08:27:27.766852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.766833 2556 scope.go:117] "RemoveContainer" containerID="984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81" Jul 14 08:27:27.774886 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.774869 2556 scope.go:117] "RemoveContainer" containerID="7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98" Jul 14 08:27:27.775174 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:27:27.775155 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98\": container with ID starting with 7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98 not found: ID does not exist" containerID="7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98" Jul 14 08:27:27.775228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.775185 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98"} err="failed to get container status \"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98\": rpc error: code = NotFound desc = could not find container \"7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98\": container with ID starting with 7ee722026d5d562052b9e84252a1e339118d65fb1dece6d35da0b7afbb847a98 not found: ID does not exist" Jul 14 08:27:27.775228 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.775206 2556 scope.go:117] "RemoveContainer" containerID="984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81" Jul 14 08:27:27.775433 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:27:27.775417 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81\": container with ID starting with 984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81 not found: ID does not exist" containerID="984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81" Jul 14 08:27:27.775476 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.775439 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81"} err="failed to get container status \"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81\": rpc error: code = NotFound desc = could not find container \"984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81\": container with ID starting with 984a7b5d7f169d24c2dd13573ad9d3589566be5a6a821098c496dfa5744f2f81 not found: ID does not exist" Jul 14 08:27:27.779657 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.779630 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:27:27.783764 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.783743 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5ae22d-openshift-default-dbd45fccf-nqvdd"] Jul 14 08:27:27.828908 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828868 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.828908 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828904 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qzbb\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-kube-api-access-7qzbb\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.828908 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828913 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.829115 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828923 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.829115 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828932 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.829115 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828939 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:27.829115 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:27.828948 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e721bf2d-42ef-441c-b915-fb4ce68a39f9-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:29.593486 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:29.593407 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" path="/var/lib/kubelet/pods/e721bf2d-42ef-441c-b915-fb4ce68a39f9/volumes" Jul 14 08:27:36.277160 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:36.277124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:27:48.627084 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:48.627044 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:27:48.627496 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:48.627306 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" containerID="cri-o://8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564" gracePeriod=30 Jul 14 08:27:49.549054 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549019 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:27:49.549375 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549362 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.549375 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549376 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.549469 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549386 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.549469 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549392 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.549469 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549452 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.549469 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.549460 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e721bf2d-42ef-441c-b915-fb4ce68a39f9" containerName="istio-proxy" Jul 14 08:27:49.553459 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.553429 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.558433 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.558406 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2198a8-openshift-default-dockercfg-f2ls5\"" Jul 14 08:27:49.568824 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.568773 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:27:49.613902 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.613868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.613902 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.613903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.613930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.613948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.614060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.614089 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614134 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.614121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614357 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.614191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z4jc\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.614357 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.614251 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715137 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4jc\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.715614 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.716065 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.716065 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.716065 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.716065 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.715978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.716424 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.716405 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.717541 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.717522 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.717768 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.717749 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.724450 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.724416 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.724620 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.724592 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z4jc\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc\") pod \"e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:49.864752 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:49.864664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:50.005553 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.005504 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:27:50.008998 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:27:50.008968 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3063f3_c727_4bf4_bc60_564fe89b7172.slice/crio-d21db951285ee78b0b45c912e227cc7d968579614ca7b7cbdb70c7c8b805ff04 WatchSource:0}: Error finding container d21db951285ee78b0b45c912e227cc7d968579614ca7b7cbdb70c7c8b805ff04: Status 404 returned error can't find the container with id d21db951285ee78b0b45c912e227cc7d968579614ca7b7cbdb70c7c8b805ff04 Jul 14 08:27:50.011448 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.011419 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:50.011508 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.011486 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:50.011553 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.011520 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:50.875991 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.875955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerStarted","Data":"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa"} Jul 14 08:27:50.876389 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.876012 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerStarted","Data":"d21db951285ee78b0b45c912e227cc7d968579614ca7b7cbdb70c7c8b805ff04"} Jul 14 08:27:50.900289 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:50.900238 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podStartSLOduration=1.9002234169999999 podStartE2EDuration="1.900223417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:27:50.897904271 +0000 UTC m=+2263.926049799" watchObservedRunningTime="2026-07-14 08:27:50.900223417 +0000 UTC m=+2263.928368944" Jul 14 08:27:51.865084 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:51.865044 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:51.869851 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:51.869798 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:51.881264 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:51.881241 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:51.882194 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:51.882175 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:27:53.883521 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.883493 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:27:53.892697 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.892623 2556 generic.go:356] "Generic (PLEG): container finished" podID="c6271c4a-f76d-48b2-b217-530e533280d6" containerID="8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564" exitCode=0 Jul 14 08:27:53.892697 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.892668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerDied","Data":"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564"} Jul 14 08:27:53.892697 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.892686 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" Jul 14 08:27:53.892941 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.892729 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7" event={"ID":"c6271c4a-f76d-48b2-b217-530e533280d6","Type":"ContainerDied","Data":"06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de"} Jul 14 08:27:53.892941 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.892760 2556 scope.go:117] "RemoveContainer" containerID="8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564" Jul 14 08:27:53.901886 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.901868 2556 scope.go:117] "RemoveContainer" containerID="9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb" Jul 14 08:27:53.910154 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.910136 2556 scope.go:117] "RemoveContainer" containerID="8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564" Jul 14 08:27:53.910476 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:27:53.910457 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564\": container with ID starting with 8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564 not found: ID does not exist" containerID="8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564" Jul 14 08:27:53.910533 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.910485 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564"} err="failed to get container status \"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564\": rpc error: code = NotFound desc = could not find container \"8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564\": container with ID starting with 8ac7b6e1f61b95517d5d0c796108a8e5a2e840892237785cf290a8bef14d2564 not found: ID does not exist" Jul 14 08:27:53.910533 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.910516 2556 scope.go:117] "RemoveContainer" containerID="9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb" Jul 14 08:27:53.910945 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:27:53.910899 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb\": container with ID starting with 9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb not found: ID does not exist" containerID="9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb" Jul 14 08:27:53.910945 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.910932 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb"} err="failed to get container status \"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb\": rpc error: code = NotFound desc = could not find container \"9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb\": container with ID starting with 9999b769e93930abc7d6309f88986df9a6afa9bf1b3007376ee6b7425620aacb not found: ID does not exist" Jul 14 08:27:53.953896 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.953861 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.953896 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.953897 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.953922 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.953939 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.953970 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954031 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954052 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954123 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954111 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954425 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954159 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qckjc\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc\") pod \"c6271c4a-f76d-48b2-b217-530e533280d6\" (UID: \"c6271c4a-f76d-48b2-b217-530e533280d6\") " Jul 14 08:27:53.954425 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954196 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:53.954425 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954210 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:53.954425 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954323 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:53.954627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954508 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:53.954627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954527 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:53.954627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954540 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:53.954627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954538 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:27:53.955013 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.954982 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:53.956371 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.956349 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:27:53.956486 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.956395 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc" (OuterVolumeSpecName: "kube-api-access-qckjc") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "kube-api-access-qckjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:27:53.956486 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.956438 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:27:53.956567 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:53.956552 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6271c4a-f76d-48b2-b217-530e533280d6" (UID: "c6271c4a-f76d-48b2-b217-530e533280d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057353 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6271c4a-f76d-48b2-b217-530e533280d6-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057395 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6271c4a-f76d-48b2-b217-530e533280d6-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057410 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057424 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qckjc\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-kube-api-access-qckjc\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057439 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6271c4a-f76d-48b2-b217-530e533280d6-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.057481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.057453 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6271c4a-f76d-48b2-b217-530e533280d6-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:27:54.222141 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.222099 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:27:54.229396 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:54.229367 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-bf6952-openshift-default-cc4f79dbc-s7lz7"] Jul 14 08:27:54.235791 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:27:54.235765 2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6271c4a_f76d_48b2_b217_530e533280d6.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6271c4a_f76d_48b2_b217_530e533280d6.slice/crio-06b5b6974399e64f9c9cf42e1dc8f46e8f16956efe583287c0dc50df04deb3de\": RecentStats: unable to find data in memory cache]" Jul 14 08:27:55.593331 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:55.593297 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" path="/var/lib/kubelet/pods/c6271c4a-f76d-48b2-b217-530e533280d6/volumes" Jul 14 08:27:57.275533 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:57.275502 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:27:58.298878 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.298832 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299194 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299205 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299217 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299222 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299272 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.299465 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.299281 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6271c4a-f76d-48b2-b217-530e533280d6" containerName="istio-proxy" Jul 14 08:27:58.303595 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.303571 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.305973 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.305951 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1851fc-openshift-default-dockercfg-c5cbf\"" Jul 14 08:27:58.313765 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.313741 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:27:58.394488 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394449 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394667 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394667 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394765 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394825 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394823 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhmp\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394950 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.394984 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.394954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496182 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhmp\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496755 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496755 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496508 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496755 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496755 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.496755 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496733 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.497001 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.496953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.497328 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.497306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.498842 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.498818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.498932 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.498916 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.506306 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.506266 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.507849 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.507830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhmp\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp\") pod \"e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.615151 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.615043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:58.793678 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.793650 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:27:58.795991 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:27:58.795962 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c304db6_40e4_4ffd_850a_2675a7130ae3.slice/crio-3dab1f5c902bdd07b050eb15d07afc78d63ba8b4ef52dfe7bd1dd51e220ff076 WatchSource:0}: Error finding container 3dab1f5c902bdd07b050eb15d07afc78d63ba8b4ef52dfe7bd1dd51e220ff076: Status 404 returned error can't find the container with id 3dab1f5c902bdd07b050eb15d07afc78d63ba8b4ef52dfe7bd1dd51e220ff076 Jul 14 08:27:58.798128 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.798089 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:58.798212 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.798165 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:58.798212 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.798198 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:27:58.920906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.920777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerStarted","Data":"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9"} Jul 14 08:27:58.920906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.920861 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerStarted","Data":"3dab1f5c902bdd07b050eb15d07afc78d63ba8b4ef52dfe7bd1dd51e220ff076"} Jul 14 08:27:58.942709 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:58.942648 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podStartSLOduration=0.942626716 podStartE2EDuration="942.626716ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:27:58.94050784 +0000 UTC m=+2271.968653369" watchObservedRunningTime="2026-07-14 08:27:58.942626716 +0000 UTC m=+2271.970772244" Jul 14 08:27:59.615890 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:59.615797 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:59.621084 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:59.621048 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:59.926743 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:59.926651 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:27:59.927545 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:27:59.927520 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:28:05.960925 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.960878 2556 generic.go:356] "Generic (PLEG): container finished" podID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerID="f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa" exitCode=0 Jul 14 08:28:05.961343 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.960951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerDied","Data":"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa"} Jul 14 08:28:05.961390 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.961347 2556 scope.go:117] "RemoveContainer" containerID="f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa" Jul 14 08:28:05.962328 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.962302 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:05.962383 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.962364 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:05.962419 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:05.962396 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:06.882117 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:06.882070 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:06.972043 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:06.971995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerStarted","Data":"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be"} Jul 14 08:28:07.867039 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:07.865659 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:07.867673 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:07.867332 2556 patch_prober.go:28] interesting pod/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 14 08:28:07.867673 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:07.867398 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 14 08:28:08.865562 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:08.865512 2556 patch_prober.go:28] interesting pod/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 14 08:28:08.866087 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:08.865584 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 14 08:28:09.866165 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:09.866119 2556 patch_prober.go:28] interesting pod/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 14 08:28:09.866680 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:09.866204 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 14 08:28:10.084285 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:10.084228 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:28:10.869176 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:10.869141 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:10.869595 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:10.869455 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:10.870272 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:10.870250 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:19.039422 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.039391 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerID="3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9" exitCode=0 Jul 14 08:28:19.039888 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.039469 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerDied","Data":"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9"} Jul 14 08:28:19.039888 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.039876 2556 scope.go:117] "RemoveContainer" containerID="3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9" Jul 14 08:28:19.040883 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.040856 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:19.040964 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.040947 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:19.041014 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:19.041000 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:28:20.046893 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:20.046856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerStarted","Data":"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac"} Jul 14 08:28:20.616062 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:20.616026 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:28:20.616356 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:20.616309 2556 patch_prober.go:28] interesting pod/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 14 08:28:20.616436 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:20.616381 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 14 08:28:21.616488 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:21.616446 2556 patch_prober.go:28] interesting pod/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 14 08:28:21.616923 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:21.616539 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 14 08:28:22.615832 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:22.615781 2556 patch_prober.go:28] interesting pod/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 14 08:28:22.616009 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:22.615852 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 14 08:28:23.615566 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:23.615530 2556 patch_prober.go:28] interesting pod/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 14 08:28:23.615976 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:23.615585 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 14 08:28:24.618920 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:24.618880 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:28:24.619354 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:24.619234 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:28:24.619993 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:24.619971 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:28:28.077018 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:28.076978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:28:39.272317 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:39.272286 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:28:39.272718 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:39.272492 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" containerID="cri-o://4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be" gracePeriod=30 Jul 14 08:28:40.872217 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:40.872177 2556 patch_prober.go:28] interesting pod/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 08:28:40.872617 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:40.872241 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 08:28:44.517004 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.516979 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:44.627699 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627603 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.627699 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627645 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z4jc\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.627699 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627665 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.627998 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627863 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.627998 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.627998 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.627967 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.628163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628015 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.628163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628021 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:28:44.628163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628040 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.628163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628090 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token\") pod \"af3063f3-c727-4bf4-bc60-564fe89b7172\" (UID: \"af3063f3-c727-4bf4-bc60-564fe89b7172\") " Jul 14 08:28:44.628163 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628151 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:28:44.628426 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628283 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:28:44.628426 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628404 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:28:44.628535 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628418 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.628535 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628456 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.628535 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.628474 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.629026 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.629004 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data" (OuterVolumeSpecName: "istio-data") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:28:44.629986 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.629964 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:28:44.630122 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.630104 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc" (OuterVolumeSpecName: "kube-api-access-2z4jc") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "kube-api-access-2z4jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:28:44.630470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.630446 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:28:44.630470 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.630456 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token" (OuterVolumeSpecName: "istio-token") pod "af3063f3-c727-4bf4-bc60-564fe89b7172" (UID: "af3063f3-c727-4bf4-bc60-564fe89b7172"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:28:44.729307 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729278 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.729307 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729305 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3063f3-c727-4bf4-bc60-564fe89b7172-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.729307 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729315 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.729525 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729324 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.729525 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729331 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3063f3-c727-4bf4-bc60-564fe89b7172-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:44.729525 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:44.729339 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z4jc\" (UniqueName: \"kubernetes.io/projected/af3063f3-c727-4bf4-bc60-564fe89b7172-kube-api-access-2z4jc\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:28:45.178088 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.178052 2556 generic.go:356] "Generic (PLEG): container finished" podID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerID="4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be" exitCode=0 Jul 14 08:28:45.178261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.178101 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" Jul 14 08:28:45.178261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.178131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerDied","Data":"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be"} Jul 14 08:28:45.178261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.178183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz" event={"ID":"af3063f3-c727-4bf4-bc60-564fe89b7172","Type":"ContainerDied","Data":"d21db951285ee78b0b45c912e227cc7d968579614ca7b7cbdb70c7c8b805ff04"} Jul 14 08:28:45.178261 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.178205 2556 scope.go:117] "RemoveContainer" containerID="4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be" Jul 14 08:28:45.187853 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.187835 2556 scope.go:117] "RemoveContainer" containerID="f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa" Jul 14 08:28:45.195684 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.195666 2556 scope.go:117] "RemoveContainer" containerID="4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be" Jul 14 08:28:45.196412 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:28:45.196393 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be\": container with ID starting with 4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be not found: ID does not exist" containerID="4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be" Jul 14 08:28:45.196474 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.196420 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be"} err="failed to get container status \"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be\": rpc error: code = NotFound desc = could not find container \"4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be\": container with ID starting with 4410fb7cd169cde62d94fa908f9624f0b51d3db6fb17999fab5509fcea91d6be not found: ID does not exist" Jul 14 08:28:45.196474 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.196437 2556 scope.go:117] "RemoveContainer" containerID="f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa" Jul 14 08:28:45.196672 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:28:45.196657 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa\": container with ID starting with f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa not found: ID does not exist" containerID="f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa" Jul 14 08:28:45.196713 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.196680 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa"} err="failed to get container status \"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa\": rpc error: code = NotFound desc = could not find container \"f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa\": container with ID starting with f9f7374434cd2163aab29ffacaaf520f84796733b3de5ee0cd2765aec1ad18aa not found: ID does not exist" Jul 14 08:28:45.200899 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.200870 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:28:45.204725 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.204705 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2198a8-openshift-default-7bfb46f9f7-fxwsz"] Jul 14 08:28:45.593904 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:45.593868 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" path="/var/lib/kubelet/pods/af3063f3-c727-4bf4-bc60-564fe89b7172/volumes" Jul 14 08:28:53.468860 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:28:53.468822 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:29:05.469584 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:05.469501 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:29:05.470054 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:05.469820 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" containerID="cri-o://0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac" gracePeriod=30 Jul 14 08:29:06.382147 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382115 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:29:06.382463 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382451 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:06.382508 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382464 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:06.382508 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382473 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:06.382508 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382478 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:06.382605 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.382546 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:06.386926 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.386908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.389456 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.389433 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0324b2-openshift-default-dockercfg-4n4nv\"" Jul 14 08:29:06.399481 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.399451 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:29:06.524014 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.523971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524014 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4gfx\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.524506 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.524358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625274 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4gfx\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625475 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625785 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625982 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625982 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.625982 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.625933 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.626358 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.626335 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.627867 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.627844 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.627967 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.627922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.633428 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.633364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.633558 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.633500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4gfx\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx\") pod \"e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.698685 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.698644 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:06.845011 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.844984 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:29:06.847074 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:29:06.847045 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebd76a6_2527_4809_868c_89cb582e4f07.slice/crio-9868385b69ecbdee7681970302b6a40a2acd254f0550a40f6776e8aaa82541bd WatchSource:0}: Error finding container 9868385b69ecbdee7681970302b6a40a2acd254f0550a40f6776e8aaa82541bd: Status 404 returned error can't find the container with id 9868385b69ecbdee7681970302b6a40a2acd254f0550a40f6776e8aaa82541bd Jul 14 08:29:06.849351 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.849320 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:06.849435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.849385 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:06.849435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:06.849412 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:07.292308 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:07.292267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerStarted","Data":"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9"} Jul 14 08:29:07.292499 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:07.292331 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerStarted","Data":"9868385b69ecbdee7681970302b6a40a2acd254f0550a40f6776e8aaa82541bd"} Jul 14 08:29:07.313239 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:07.313175 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podStartSLOduration=1.313154854 podStartE2EDuration="1.313154854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:29:07.312678715 +0000 UTC m=+2340.340824242" watchObservedRunningTime="2026-07-14 08:29:07.313154854 +0000 UTC m=+2340.341300382" Jul 14 08:29:07.699872 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:07.699781 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:07.704647 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:07.704623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:08.297376 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:08.297347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:08.298428 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:08.298407 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:09.621461 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:09.621423 2556 patch_prober.go:28] interesting pod/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 08:29:09.621868 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:09.621481 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 08:29:10.730544 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.730515 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:29:10.866657 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866623 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.866876 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866665 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.866876 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866728 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.866876 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866767 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jhmp\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.866876 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866865 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.867125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866923 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.867125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866955 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.867125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.866990 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.867125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867018 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket\") pod \"7c304db6-40e4-4ffd-850a-2675a7130ae3\" (UID: \"7c304db6-40e4-4ffd-850a-2675a7130ae3\") " Jul 14 08:29:10.867375 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867348 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:29:10.867441 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867393 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:29:10.867560 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867542 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:29:10.867627 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867588 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:29:10.867746 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.867723 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:29:10.869137 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.869113 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:29:10.869300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.869282 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:29:10.869445 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.869421 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:29:10.869445 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.869432 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp" (OuterVolumeSpecName: "kube-api-access-6jhmp") pod "7c304db6-40e4-4ffd-850a-2675a7130ae3" (UID: "7c304db6-40e4-4ffd-850a-2675a7130ae3"). InnerVolumeSpecName "kube-api-access-6jhmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:29:10.968212 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968175 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968212 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968207 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jhmp\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-kube-api-access-6jhmp\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968222 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968237 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c304db6-40e4-4ffd-850a-2675a7130ae3-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968248 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968259 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968269 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c304db6-40e4-4ffd-850a-2675a7130ae3-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968282 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:10.968442 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:10.968293 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c304db6-40e4-4ffd-850a-2675a7130ae3-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:29:11.314084 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.314043 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerID="0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac" exitCode=0 Jul 14 08:29:11.314084 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.314095 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" Jul 14 08:29:11.314300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.314110 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerDied","Data":"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac"} Jul 14 08:29:11.314300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.314162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9" event={"ID":"7c304db6-40e4-4ffd-850a-2675a7130ae3","Type":"ContainerDied","Data":"3dab1f5c902bdd07b050eb15d07afc78d63ba8b4ef52dfe7bd1dd51e220ff076"} Jul 14 08:29:11.314300 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.314187 2556 scope.go:117] "RemoveContainer" containerID="0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac" Jul 14 08:29:11.324777 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.324759 2556 scope.go:117] "RemoveContainer" containerID="3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9" Jul 14 08:29:11.332642 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.332622 2556 scope.go:117] "RemoveContainer" containerID="0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac" Jul 14 08:29:11.332922 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:29:11.332901 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac\": container with ID starting with 0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac not found: ID does not exist" containerID="0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac" Jul 14 08:29:11.333007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.332931 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac"} err="failed to get container status \"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac\": rpc error: code = NotFound desc = could not find container \"0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac\": container with ID starting with 0d331fbfac2e939786d48acaeaa01ba4f49f603efbf92080a5e4c2634e65f2ac not found: ID does not exist" Jul 14 08:29:11.333007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.332949 2556 scope.go:117] "RemoveContainer" containerID="3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9" Jul 14 08:29:11.333196 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:29:11.333178 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9\": container with ID starting with 3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9 not found: ID does not exist" containerID="3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9" Jul 14 08:29:11.333245 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.333204 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9"} err="failed to get container status \"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9\": rpc error: code = NotFound desc = could not find container \"3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9\": container with ID starting with 3e3539150178a37b27ac6ed6e7ff6b3f0009b74f4a9bb4e5b9556a504f2d85d9 not found: ID does not exist" Jul 14 08:29:11.337418 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.337394 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:29:11.341259 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.341238 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1851fc-openshift-default-7d97d794b9-k6zm9"] Jul 14 08:29:11.594903 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:11.594817 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" path="/var/lib/kubelet/pods/7c304db6-40e4-4ffd-850a-2675a7130ae3/volumes" Jul 14 08:29:14.397408 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397375 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397717 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397728 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397740 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397746 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397821 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3063f3-c727-4bf4-bc60-564fe89b7172" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397830 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.397895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.397837 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c304db6-40e4-4ffd-850a-2675a7130ae3" containerName="istio-proxy" Jul 14 08:29:14.400952 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.400925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.403438 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.403414 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b9c837-openshift-default-dockercfg-5h8wj\"" Jul 14 08:29:14.413866 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.413840 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:29:14.498616 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.498836 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.498836 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.498836 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.499007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.499007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.499007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.498948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.499106 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.499044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.499158 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.499100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82628\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600045 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600045 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600320 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600320 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600320 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600320 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82628\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600410 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600451 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600710 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.600752 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.600730 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.601071 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.601052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.602672 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.602651 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.602898 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.602881 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.609161 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.609137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.609357 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.609338 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82628\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628\") pod \"e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.684411 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.684320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:29:14.712283 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.712245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:14.857828 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.857784 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:29:14.859906 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:29:14.859883 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773947b3_060b_4ce4_a696_7e8175315bcc.slice/crio-7bf5460489bd923a7650c011227d0a7502c508082df1fd5c9f82b51669789bcf WatchSource:0}: Error finding container 7bf5460489bd923a7650c011227d0a7502c508082df1fd5c9f82b51669789bcf: Status 404 returned error can't find the container with id 7bf5460489bd923a7650c011227d0a7502c508082df1fd5c9f82b51669789bcf Jul 14 08:29:14.862103 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.862062 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:14.862184 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.862160 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:14.862223 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:14.862208 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:15.337700 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:15.337660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerStarted","Data":"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff"} Jul 14 08:29:15.337934 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:15.337726 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerStarted","Data":"7bf5460489bd923a7650c011227d0a7502c508082df1fd5c9f82b51669789bcf"} Jul 14 08:29:15.357568 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:15.357511 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podStartSLOduration=1.357494024 podStartE2EDuration="1.357494024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 08:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:29:15.356165352 +0000 UTC m=+2348.384310879" watchObservedRunningTime="2026-07-14 08:29:15.357494024 +0000 UTC m=+2348.385639623" Jul 14 08:29:15.713339 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:15.713239 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:15.718281 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:15.718260 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:16.342771 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:16.342742 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:16.343863 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:16.343838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:23.299580 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.299542 2556 patch_prober.go:28] interesting pod/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 14 08:29:23.300111 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.299607 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 14 08:29:23.386434 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.386401 2556 generic.go:356] "Generic (PLEG): container finished" podID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerID="a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9" exitCode=0 Jul 14 08:29:23.386606 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.386483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerDied","Data":"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9"} Jul 14 08:29:23.387041 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.387021 2556 scope.go:117] "RemoveContainer" containerID="a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9" Jul 14 08:29:23.388233 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.388206 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:23.388308 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.388292 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:23.388356 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:23.388340 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:24.399170 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:24.399137 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerStarted","Data":"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155"} Jul 14 08:29:24.699415 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:24.699309 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:24.699745 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:24.699721 2556 patch_prober.go:28] interesting pod/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 14 08:29:24.699913 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:24.699887 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 14 08:29:25.699959 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:25.699917 2556 patch_prober.go:28] interesting pod/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 14 08:29:25.700344 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:25.699991 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 14 08:29:26.699732 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:26.699683 2556 patch_prober.go:28] interesting pod/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 14 08:29:26.699958 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:26.699828 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 14 08:29:27.276729 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:27.276667 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:29:27.699661 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:27.699567 2556 patch_prober.go:28] interesting pod/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 14 08:29:27.699661 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:27.699622 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 14 08:29:28.703364 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:28.703324 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:28.703884 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:28.703560 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:28.704256 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:28.704236 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:29:29.433670 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.433576 2556 generic.go:356] "Generic (PLEG): container finished" podID="773947b3-060b-4ce4-a696-7e8175315bcc" containerID="76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff" exitCode=0 Jul 14 08:29:29.433670 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.433651 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerDied","Data":"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff"} Jul 14 08:29:29.434249 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.434227 2556 scope.go:117] "RemoveContainer" containerID="76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff" Jul 14 08:29:29.435246 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.435220 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:29.435331 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.435285 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:29.435331 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:29.435318 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 14 08:29:30.441173 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:30.441133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerStarted","Data":"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e"} Jul 14 08:29:30.712983 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:30.712821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:30.714273 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:30.714235 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 14 08:29:30.714441 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:30.714308 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 14 08:29:31.342911 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:31.342875 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:31.713037 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:31.712948 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 14 08:29:31.713037 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:31.713006 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 14 08:29:32.713492 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:32.713443 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 14 08:29:32.714007 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:32.713527 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 14 08:29:33.713204 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:33.713166 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 14 08:29:33.713385 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:33.713232 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 14 08:29:34.712665 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:34.712617 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 14 08:29:34.713194 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:34.712683 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 14 08:29:35.717144 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:35.717114 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:35.718143 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:35.718121 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:29:40.669544 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:29:40.669506 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:30:29.886937 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:30:29.886846 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:30:44.893096 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:30:44.893059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:31:02.173452 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:31:02.173417 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:31:19.872170 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:31:19.872125 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:31:37.182137 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:31:37.182103 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:31:52.576532 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:31:52.576492 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:32:11.986743 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:32:11.986660 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:32:30.276887 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:32:30.276847 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:32:47.579973 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:32:47.579940 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:33:04.478589 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:33:04.478537 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:33:25.775311 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:33:25.775275 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:33:48.484547 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:33:48.484509 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:34:07.972633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:34:07.972601 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:34:40.085005 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:34:40.084964 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:35:01.583351 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:35:01.583253 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:35:17.184395 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:35:17.184359 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:35:31.902939 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:35:31.902900 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:35:56.375466 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:35:56.375431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:36:08.004435 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:08.004399 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:36:08.005029 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:08.004650 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" containerID="cri-o://61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155" gracePeriod=30 Jul 14 08:36:13.265082 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.265057 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:36:13.280920 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.280885 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281068 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.280925 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281068 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.280979 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281068 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.280996 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4gfx\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281068 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281028 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281068 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281049 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281353 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281083 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281353 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281112 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281353 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281156 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo\") pod \"1ebd76a6-2527-4809-868c-89cb582e4f07\" (UID: \"1ebd76a6-2527-4809-868c-89cb582e4f07\") " Jul 14 08:36:13.281353 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281180 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:13.281551 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281433 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.281551 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281432 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:13.281551 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281464 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:13.281551 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281500 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:36:13.281930 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.281908 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:13.283225 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.283195 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx" (OuterVolumeSpecName: "kube-api-access-m4gfx") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "kube-api-access-m4gfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:36:13.283439 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.283423 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:13.283571 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.283558 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:36:13.283619 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.283579 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ebd76a6-2527-4809-868c-89cb582e4f07" (UID: "1ebd76a6-2527-4809-868c-89cb582e4f07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:36:13.382634 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382597 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382634 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382629 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4gfx\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-kube-api-access-m4gfx\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382634 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382638 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382647 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382656 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebd76a6-2527-4809-868c-89cb582e4f07-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382665 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382674 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.382906 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.382682 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebd76a6-2527-4809-868c-89cb582e4f07-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:13.503125 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.503090 2556 generic.go:356] "Generic (PLEG): container finished" podID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerID="61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155" exitCode=0 Jul 14 08:36:13.503290 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.503143 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" Jul 14 08:36:13.503290 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.503174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerDied","Data":"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155"} Jul 14 08:36:13.503290 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.503236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8" event={"ID":"1ebd76a6-2527-4809-868c-89cb582e4f07","Type":"ContainerDied","Data":"9868385b69ecbdee7681970302b6a40a2acd254f0550a40f6776e8aaa82541bd"} Jul 14 08:36:13.503290 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.503260 2556 scope.go:117] "RemoveContainer" containerID="61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155" Jul 14 08:36:13.515245 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.515225 2556 scope.go:117] "RemoveContainer" containerID="a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9" Jul 14 08:36:13.523639 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.523617 2556 scope.go:117] "RemoveContainer" containerID="61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155" Jul 14 08:36:13.524316 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:36:13.524291 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155\": container with ID starting with 61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155 not found: ID does not exist" containerID="61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155" Jul 14 08:36:13.524411 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.524322 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155"} err="failed to get container status \"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155\": rpc error: code = NotFound desc = could not find container \"61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155\": container with ID starting with 61231adf092a3ad880a8018802e1d97fdbe8afd0070bbbeea040520754872155 not found: ID does not exist" Jul 14 08:36:13.524411 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.524341 2556 scope.go:117] "RemoveContainer" containerID="a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9" Jul 14 08:36:13.524612 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:36:13.524590 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9\": container with ID starting with a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9 not found: ID does not exist" containerID="a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9" Jul 14 08:36:13.524675 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.524623 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9"} err="failed to get container status \"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9\": rpc error: code = NotFound desc = could not find container \"a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9\": container with ID starting with a31f3e3a6e2e933f9ab9641553267b26a41fee7e20a47047293fce28ddcd46e9 not found: ID does not exist" Jul 14 08:36:13.526159 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.526141 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:36:13.531273 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.531217 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0324b2-openshift-default-74898ffb67-nzcf8"] Jul 14 08:36:13.594114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:13.594081 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" path="/var/lib/kubelet/pods/1ebd76a6-2527-4809-868c-89cb582e4f07/volumes" Jul 14 08:36:22.373743 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:22.373701 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s5c8r"] Jul 14 08:36:34.202861 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:34.202824 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:36:34.203352 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:34.203102 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" containerID="cri-o://0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e" gracePeriod=30 Jul 14 08:36:35.719636 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:35.719600 2556 patch_prober.go:28] interesting pod/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 08:36:35.720090 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:35.719668 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 08:36:39.450323 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.450294 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:36:39.518839 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.518788 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.518873 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.518899 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82628\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.518928 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519003 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.518984 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519192 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519030 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519192 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519054 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519192 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519104 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519192 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519128 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs\") pod \"773947b3-060b-4ce4-a696-7e8175315bcc\" (UID: \"773947b3-060b-4ce4-a696-7e8175315bcc\") " Jul 14 08:36:39.519406 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519212 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:39.519406 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519228 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 08:36:39.519523 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519439 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:39.519523 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519457 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:39.519633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519550 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.519633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519566 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-workload-certs\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.519633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519579 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773947b3-060b-4ce4-a696-7e8175315bcc-istiod-ca-cert\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.519633 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.519592 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-credential-socket\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.520230 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.520204 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data" (OuterVolumeSpecName: "istio-data") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:39.521235 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.521208 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 08:36:39.521335 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.521279 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token" (OuterVolumeSpecName: "istio-token") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:36:39.521335 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.521286 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628" (OuterVolumeSpecName: "kube-api-access-82628") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "kube-api-access-82628". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 08:36:39.521335 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.521308 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "773947b3-060b-4ce4-a696-7e8175315bcc" (UID: "773947b3-060b-4ce4-a696-7e8175315bcc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 08:36:39.621052 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.621018 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773947b3-060b-4ce4-a696-7e8175315bcc-istio-podinfo\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.621052 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.621045 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-istio-token\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.621052 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.621054 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-envoy\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.621259 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.621062 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773947b3-060b-4ce4-a696-7e8175315bcc-istio-data\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.621259 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.621070 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82628\" (UniqueName: \"kubernetes.io/projected/773947b3-060b-4ce4-a696-7e8175315bcc-kube-api-access-82628\") on node \"ip-10-0-128-86.ec2.internal\" DevicePath \"\"" Jul 14 08:36:39.641687 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.641655 2556 generic.go:356] "Generic (PLEG): container finished" podID="773947b3-060b-4ce4-a696-7e8175315bcc" containerID="0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e" exitCode=0 Jul 14 08:36:39.641852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.641705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerDied","Data":"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e"} Jul 14 08:36:39.641852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.641743 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" event={"ID":"773947b3-060b-4ce4-a696-7e8175315bcc","Type":"ContainerDied","Data":"7bf5460489bd923a7650c011227d0a7502c508082df1fd5c9f82b51669789bcf"} Jul 14 08:36:39.641852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.641766 2556 scope.go:117] "RemoveContainer" containerID="0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e" Jul 14 08:36:39.641852 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.641707 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk" Jul 14 08:36:39.650601 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.650581 2556 scope.go:117] "RemoveContainer" containerID="76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff" Jul 14 08:36:39.660640 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.660615 2556 scope.go:117] "RemoveContainer" containerID="0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e" Jul 14 08:36:39.661297 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:36:39.661270 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e\": container with ID starting with 0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e not found: ID does not exist" containerID="0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e" Jul 14 08:36:39.661394 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.661311 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e"} err="failed to get container status \"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e\": rpc error: code = NotFound desc = could not find container \"0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e\": container with ID starting with 0e1f50b6fdad7ee5394c5faeb43e93a2b54a6dbaa0ef12bbde82ca68da36046e not found: ID does not exist" Jul 14 08:36:39.661394 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.661336 2556 scope.go:117] "RemoveContainer" containerID="76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff" Jul 14 08:36:39.661764 ip-10-0-128-86 kubenswrapper[2556]: E0714 08:36:39.661739 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff\": container with ID starting with 76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff not found: ID does not exist" containerID="76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff" Jul 14 08:36:39.661873 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.661773 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff"} err="failed to get container status \"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff\": rpc error: code = NotFound desc = could not find container \"76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff\": container with ID starting with 76ca1b69455036cbc4df17d5f8b34aa7f0790c657b7b16355884c59a512ec8ff not found: ID does not exist" Jul 14 08:36:39.664059 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.664041 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:36:39.668622 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:39.668599 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b9c837-openshift-default-6dcbf98587-4dlhk"] Jul 14 08:36:40.390236 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:40.390209 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf_a6397958-12e3-48da-9119-73ce39d65bad/copy-manifests/0.log" Jul 14 08:36:40.398561 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:40.398531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf_a6397958-12e3-48da-9119-73ce39d65bad/manager/0.log" Jul 14 08:36:41.593728 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:41.593698 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" path="/var/lib/kubelet/pods/773947b3-060b-4ce4-a696-7e8175315bcc/volumes" Jul 14 08:36:43.736367 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.736336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/extract/0.log" Jul 14 08:36:43.744050 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.744016 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/util/0.log" Jul 14 08:36:43.751024 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.751001 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/pull/0.log" Jul 14 08:36:43.866824 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.866771 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/util/0.log" Jul 14 08:36:43.873280 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.873257 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/pull/0.log" Jul 14 08:36:43.879114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.879080 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/extract/0.log" Jul 14 08:36:43.999386 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:43.999301 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/pull/0.log" Jul 14 08:36:44.007093 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.007062 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/extract/0.log" Jul 14 08:36:44.013756 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.013728 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/util/0.log" Jul 14 08:36:44.129927 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.129891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/util/0.log" Jul 14 08:36:44.136830 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.136776 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/pull/0.log" Jul 14 08:36:44.143822 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.143781 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/extract/0.log" Jul 14 08:36:44.970874 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:44.970842 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s5c8r_99567d58-962b-49d1-a35f-03c6778dc97e/limitador/0.log" Jul 14 08:36:45.465891 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:45.465862 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fq8t7_6d6ac866-cd70-4f9a-a675-0049881d2e42/istio-proxy/0.log" Jul 14 08:36:45.596158 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:45.596126 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xvcqm_90890e4e-91f4-4ded-a4c2-74bb325de4e2/discovery/0.log" Jul 14 08:36:46.874074 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:46.874046 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6bbzs_20bd8fae-18fd-4ef3-8b69-f8ef57832424/main/0.log" Jul 14 08:36:54.866663 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:54.866625 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j45vv_0de23af4-ddf6-481f-897b-9cb274054915/global-pull-secret-syncer/0.log" Jul 14 08:36:55.041333 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:55.041297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zsg52_53ba54c9-daa2-4913-96c0-4a101a4f4cc7/konnectivity-agent/0.log" Jul 14 08:36:55.069967 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:55.069932 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-86.ec2.internal_08b1320a39f521a3cd69b9201d40291d/haproxy/0.log" Jul 14 08:36:59.710844 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.710787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/extract/0.log" Jul 14 08:36:59.737483 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.737450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/util/0.log" Jul 14 08:36:59.766476 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.766445 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596br7k_56238cd3-a37e-4255-8e2c-9296c28259f2/pull/0.log" Jul 14 08:36:59.806574 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.806523 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/extract/0.log" Jul 14 08:36:59.833959 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.833928 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/util/0.log" Jul 14 08:36:59.857971 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.857935 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lcz9w_abd0394a-98f6-4123-ad14-55947e307050/pull/0.log" Jul 14 08:36:59.908202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.908173 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/extract/0.log" Jul 14 08:36:59.931880 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.931842 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/util/0.log" Jul 14 08:36:59.955328 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.955297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qvpgf_c6a24380-b39b-4b88-bb2a-0bd3cf51a99f/pull/0.log" Jul 14 08:36:59.984108 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:36:59.984028 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/extract/0.log" Jul 14 08:37:00.011462 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:00.011430 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/util/0.log" Jul 14 08:37:00.038238 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:00.038210 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fgc7j_d1bce5e3-3a8e-41d0-b58b-378450dd407b/pull/0.log" Jul 14 08:37:00.611894 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:00.611861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s5c8r_99567d58-962b-49d1-a35f-03c6778dc97e/limitador/0.log" Jul 14 08:37:02.470936 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.470849 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/alertmanager/0.log" Jul 14 08:37:02.493883 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.493847 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/config-reloader/0.log" Jul 14 08:37:02.520327 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.520297 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/kube-rbac-proxy-web/0.log" Jul 14 08:37:02.554461 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.554433 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/kube-rbac-proxy/0.log" Jul 14 08:37:02.579016 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.578987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/kube-rbac-proxy-metric/0.log" Jul 14 08:37:02.602593 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.602559 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/prom-label-proxy/0.log" Jul 14 08:37:02.631202 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.631174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9c3e7aad-1105-4bf8-b5e4-904850e4e116/init-config-reloader/0.log" Jul 14 08:37:02.927139 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.927114 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrqdr_c2ee72e8-9f8e-4f4a-8287-ce87f79568e2/node-exporter/0.log" Jul 14 08:37:02.948600 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.948572 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrqdr_c2ee72e8-9f8e-4f4a-8287-ce87f79568e2/kube-rbac-proxy/0.log" Jul 14 08:37:02.970562 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:02.970536 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrqdr_c2ee72e8-9f8e-4f4a-8287-ce87f79568e2/init-textfile/0.log" Jul 14 08:37:03.093617 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.093584 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t8b6b_8029ea26-c0d1-4b63-9743-4da858fb9f72/kube-rbac-proxy-main/0.log" Jul 14 08:37:03.117646 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.117621 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t8b6b_8029ea26-c0d1-4b63-9743-4da858fb9f72/kube-rbac-proxy-self/0.log" Jul 14 08:37:03.153616 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.153582 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-t8b6b_8029ea26-c0d1-4b63-9743-4da858fb9f72/openshift-state-metrics/0.log" Jul 14 08:37:03.432669 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.432610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-thdsb_03b4f929-1af4-487e-a4dd-98e91c3c2170/prometheus-operator-admission-webhook/0.log" Jul 14 08:37:03.478612 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.478583 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77dd9bb68c-nkbxn_1253f9dd-67a0-4d99-b3aa-cb889f7b1845/telemeter-client/0.log" Jul 14 08:37:03.512033 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.512004 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77dd9bb68c-nkbxn_1253f9dd-67a0-4d99-b3aa-cb889f7b1845/reload/0.log" Jul 14 08:37:03.540474 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.540447 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77dd9bb68c-nkbxn_1253f9dd-67a0-4d99-b3aa-cb889f7b1845/kube-rbac-proxy/0.log" Jul 14 08:37:03.572536 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.572504 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/thanos-query/0.log" Jul 14 08:37:03.597301 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.597274 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/kube-rbac-proxy-web/0.log" Jul 14 08:37:03.620669 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.620633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/kube-rbac-proxy/0.log" Jul 14 08:37:03.649729 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.649685 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/prom-label-proxy/0.log" Jul 14 08:37:03.672103 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.672073 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/kube-rbac-proxy-rules/0.log" Jul 14 08:37:03.695681 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:03.695561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7857f8d8d4-dpwrn_3d1fbe16-5100-4ed9-b0c0-8c5d3be590b5/kube-rbac-proxy-metrics/0.log" Jul 14 08:37:05.413730 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.413692 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2"] Jul 14 08:37:05.414252 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414201 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" Jul 14 08:37:05.414252 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414219 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" Jul 14 08:37:05.414252 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414232 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.414252 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414240 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.414252 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414253 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414262 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414295 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414304 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414396 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="773947b3-060b-4ce4-a696-7e8175315bcc" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414412 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.414512 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.414421 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebd76a6-2527-4809-868c-89cb582e4f07" containerName="istio-proxy" Jul 14 08:37:05.417781 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.417763 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.420262 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.420242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"openshift-service-ca.crt\"" Jul 14 08:37:05.421145 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.421127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxkpt\"/\"default-dockercfg-t94tj\"" Jul 14 08:37:05.421209 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.421127 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxkpt\"/\"kube-root-ca.crt\"" Jul 14 08:37:05.428098 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.428076 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2"] Jul 14 08:37:05.441272 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.441239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-proc\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.441433 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.441300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-podres\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.441433 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.441358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-sys\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.441433 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.441382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-lib-modules\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.441558 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.441465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4fd\" (UniqueName: \"kubernetes.io/projected/3dce1c0f-f485-4d20-92c3-7595930fe57f-kube-api-access-mg4fd\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542679 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-proc\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542689 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-podres\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-sys\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-lib-modules\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4fd\" (UniqueName: \"kubernetes.io/projected/3dce1c0f-f485-4d20-92c3-7595930fe57f-kube-api-access-mg4fd\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542776 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-proc\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.542901 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542861 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-sys\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.543117 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-podres\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.543117 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.542923 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dce1c0f-f485-4d20-92c3-7595930fe57f-lib-modules\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.551564 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.551535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4fd\" (UniqueName: \"kubernetes.io/projected/3dce1c0f-f485-4d20-92c3-7595930fe57f-kube-api-access-mg4fd\") pod \"perf-node-gather-daemonset-n6sb2\" (UID: \"3dce1c0f-f485-4d20-92c3-7595930fe57f\") " pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.728563 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.728486 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:05.866555 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:05.866529 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2"] Jul 14 08:37:05.868000 ip-10-0-128-86 kubenswrapper[2556]: W0714 08:37:05.867971 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3dce1c0f_f485_4d20_92c3_7595930fe57f.slice/crio-e381aabbf16be6cf61e8b0c6a743c5858609ee1313d2e8dd581764e26e5b3334 WatchSource:0}: Error finding container e381aabbf16be6cf61e8b0c6a743c5858609ee1313d2e8dd581764e26e5b3334: Status 404 returned error can't find the container with id e381aabbf16be6cf61e8b0c6a743c5858609ee1313d2e8dd581764e26e5b3334 Jul 14 08:37:06.782491 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:06.782458 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" event={"ID":"3dce1c0f-f485-4d20-92c3-7595930fe57f","Type":"ContainerStarted","Data":"3e0ad9150e821c889a344195d3c9b68a2dd9150b55e5877d9753886f6b2f4af4"} Jul 14 08:37:06.783069 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:06.782507 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" event={"ID":"3dce1c0f-f485-4d20-92c3-7595930fe57f","Type":"ContainerStarted","Data":"e381aabbf16be6cf61e8b0c6a743c5858609ee1313d2e8dd581764e26e5b3334"} Jul 14 08:37:06.783069 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:06.782566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:06.822348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:06.822293 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" podStartSLOduration=1.822278415 podStartE2EDuration="1.822278415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 08:37:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 08:37:06.820209791 +0000 UTC m=+2819.848355317" watchObservedRunningTime="2026-07-14 08:37:06.822278415 +0000 UTC m=+2819.850423941" Jul 14 08:37:07.924767 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:07.924730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-stlhf_a71e9481-23c9-4a7f-9c44-f3bc5b6d0602/dns/0.log" Jul 14 08:37:07.949693 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:07.949661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-stlhf_a71e9481-23c9-4a7f-9c44-f3bc5b6d0602/kube-rbac-proxy/0.log" Jul 14 08:37:08.021219 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:08.021193 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-644rv_7e1e40d2-5011-43b3-8f3d-b557cfb99430/dns-node-resolver/0.log" Jul 14 08:37:08.611681 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:08.611646 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59c9fcff9b-2d85v_176746ed-cfbc-40e0-9316-28a803c8f920/registry/0.log" Jul 14 08:37:08.663764 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:08.663733 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jwbql_ce475909-65d7-4853-8c25-107065c477ac/node-ca/0.log" Jul 14 08:37:09.648855 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:09.648794 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fq8t7_6d6ac866-cd70-4f9a-a675-0049881d2e42/istio-proxy/0.log" Jul 14 08:37:09.851895 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:09.851861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xvcqm_90890e4e-91f4-4ded-a4c2-74bb325de4e2/discovery/0.log" Jul 14 08:37:10.842447 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:10.842415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zbpfm_3005873c-318a-4776-b0eb-421555f8d20a/serve-healthcheck-canary/0.log" Jul 14 08:37:11.507138 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:11.507104 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4ts7_36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e/kube-rbac-proxy/0.log" Jul 14 08:37:11.529674 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:11.529649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4ts7_36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e/exporter/0.log" Jul 14 08:37:11.553199 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:11.553172 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4ts7_36ea3bee-6aaa-46aa-b1fc-e0dddac1b40e/extractor/0.log" Jul 14 08:37:12.797850 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:12.797821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxkpt/perf-node-gather-daemonset-n6sb2" Jul 14 08:37:14.103663 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:14.103630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf_a6397958-12e3-48da-9119-73ce39d65bad/manager/0.log" Jul 14 08:37:14.128521 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:14.128492 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd97c5d4c-9k6xf_a6397958-12e3-48da-9119-73ce39d65bad/copy-manifests/0.log" Jul 14 08:37:15.763063 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:15.763022 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fq8t7_6d6ac866-cd70-4f9a-a675-0049881d2e42/istio-proxy/0.log" Jul 14 08:37:15.885244 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:15.885155 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67649569dd-m8zvz_b0583099-d9b5-45e3-a5fd-259b2f5e4784/manager/0.log" Jul 14 08:37:15.956720 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:15.956692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xvcqm_90890e4e-91f4-4ded-a4c2-74bb325de4e2/discovery/0.log" Jul 14 08:37:17.398393 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:17.398360 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678fq8t7_6d6ac866-cd70-4f9a-a675-0049881d2e42/istio-proxy/0.log" Jul 14 08:37:17.601005 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:17.600975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xvcqm_90890e4e-91f4-4ded-a4c2-74bb325de4e2/discovery/0.log" Jul 14 08:37:22.660348 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.660322 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/kube-multus-additional-cni-plugins/0.log" Jul 14 08:37:22.686019 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.685987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/egress-router-binary-copy/0.log" Jul 14 08:37:22.711770 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.711738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/cni-plugins/0.log" Jul 14 08:37:22.738008 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.737985 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/bond-cni-plugin/0.log" Jul 14 08:37:22.762747 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.762715 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/routeoverride-cni/0.log" Jul 14 08:37:22.789114 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.789086 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/whereabouts-cni-bincopy/0.log" Jul 14 08:37:22.818611 ip-10-0-128-86 kubenswrapper[2556]: I0714 08:37:22.818575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f2s9t_dda8640c-cfe2-48a6-9b0b-76703beaebc9/whereabouts-cni/0.log"